EdTech Tracker

← Coding lens

text embedding 3 small

tool judged 0% likely a named technique or architecture

First seen
2024-06-26
Independent sources
6
Articles
17
Last 4 weeks vs prior
0 vs 3

See how it has spread across media tiers

Mentions over time

Articles per week (by publish date) using the term, in any spelling.
02.552024-W262026-W242026-W41
Table view
WeekArticlesSources
2024-W2611
2026-W0931
2026-W1151
2026-W1911
2026-W2421
2026-W2511
2026-W3311
2026-W4022
2026-W4111

In their words

get ( " version " , " 1.0 " ), } Phase 2: Embedding & Vector Storage Embedding Model Selection Model Dimensions Speed Quality Cost Best For text-embedding-3-small 1536 Fast Good $0.02/M General purpose text-embedding-3-large 3072 Medium Best $0.13/M High accuracy needs bge-base-en-v1.5 768 Fast Good Free (local) Privacy/offline bge-large-en-v1.5 1024 Medium Better Free (local) Quality + privacy e5

Here's what my logs showed, roughly, on the same internal docs corpus: Old model (ada-002) New model (text-embedding-3-small) Top-1 score, questions with a real answer ~0.84 median ~0.55 median Score between two random unrelated chunks ~0.72 median ~0.18 median Look at the right column first.

The RAG-Ready Checklist Before you push this data to your embedding model (like OpenAI’s text-embedding-3-small or a local HuggingFace model), run this quality check: [ ] Noise Removal: Did you use Crawl4AI’s css_selector to exclude headers/footers?

text-embedding-3-small # NEO4J_EMBEDDING_DIMENSIONS: "<n>" # only if stored vectors use a reduced dimension Step 3 — Redeploy, wiring the key from Secret Manager.

OpenAI text-embedding-3-small at $0.02 / 1M tokens is the cheapest mainstream option and supports Matryoshka dimension reduction down to 512d with minimal accuracy loss.

Code Example (LangChain)# from langchain_experimental.text_splitter import SemanticChunker from langchain_openai import OpenAIEmbeddings # Initialize with OpenAI embeddings embeddings = OpenAIEmbeddings(model="text-embedding-3-small") splitter = SemanticChunker( embeddings=embeddings, breakpoint_threshold_type="percentile", # Options: percentile, standard_deviation, interquartile breakpoint_thresh

RAG Costs# | Cost Component | Typical Monthly Cost | Notes | |---|---|---| | Vector database hosting | $50–$300 | Depends on corpus size (e.g., Pinecone, Weaviate, self-hosted) | | Embedding API calls | $20–$150 | For indexing + query embeddings (OpenAI text-embedding-3-small) | | LLM inference (generation) | $100–$2,000 | Depends on query volume and context length | | Document ingestion pipeline

Components 3–4: Vectorization & Storage Layer (Embedding + Vector DB)# Converting text to vectors is the foundation of semantic search, requiring three key decisions: an embedding model (e.g., text-embedding-3-small), a chunking strategy (chunk size and handling continuity across paragraphs), and a vector database (Pinecone, Weaviate, Qdrant, or self-hosted pgvector).