Skip to content

Instantly share code, notes, and snippets.

View leafac's full-sized avatar

Leandro Facchinetti leafac

View GitHub Profile
node-llama-cpp Ollama @huggingface/transformers Gemini
Download size 491.4MB 397MB 862.1MB —
Running time 3s 6s 13s 17s
Memory 700MB 458MB 2GB —
Quality of answer 2 2 0 9
  • node-llama-cpp: Not good for vector embedding. Good for LLM. Runs in process.
  • Ollama: Good for vector embedding. Good for LLM. Runs as a separate process.
  • @huggingface/transformers: Good for vector embedding. Not good for LLM.
  • Companies
    • Anthropic
    • OpenAI
    • Anysphere
    • Cognition AI
    • Codeium
    • Sourcegraph
    • GitHub
    • Google
  • Continue.dev
  • Encrypt data at rest
    • SQLite database only
      • SQLCipher / @journeyapps/sqlcipher
      • SQLite3 Multiple Ciphers / better-sqlite3-multiple-ciphers
      • No: It’s cumbersome because it requires us to change the SQLite that we use (which happens to be Node.js’s SQLite, so we probably want to keep that simple)
    • Directory
      • gocryptfs
        • FUSE
        • Replaces EncFS and ecryptfs
  • No: Could interact badly with SQLite, because it needs advanced filesystem features including locking, fsync() and so forth

Setting up Ubuntu Cloud virtual machine in macOS with QEMU

Install QEMU:

brew install qemu

Download Ubuntu Cloud:

$ brew uninstall --verbose --debug docker-desktop
/opt/homebrew/Library/Homebrew/brew.rb (Cask::CaskLoader::FromAPILoader): loading docker-desktop
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/lame
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/llhttp
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/libtiff
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/gmp
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/libiconv
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/deno
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/ffmpeg
```console
$ brew uninstall --verbose --debug docker-desktop
/opt/homebrew/Library/Homebrew/brew.rb (Cask::CaskLoader::FromAPILoader): loading docker-desktop
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/lame
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/llhttp
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/libtiff
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/gmp
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/libiconv
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/deno
/opt/homebrew/Library/Homebrew/brew.rb (Formulary::FromAPILoader): loading homebrew/core/ffmpeg