![[Resource] 30k IKEA products converted to text files. Saves 24% tokens. RAG benchmark.](https://www.tweakedgeek.com/wp-content/uploads/2026/01/featured-article-9368-300x171.png)
Converting 30,511 IKEA products from JSON to a markdown-like format called CommerceTXT significantly reduces token usage by 24%, allowing more efficient use of memory for applications like Llama-3. This new format enables over 20% more products to fit within a context window, making it highly efficient for data retrieval and testing, especially in scenarios where context is limited. The structured format organizes data into folders by categories without the clutter of HTML or scripts, making it ready for use with tools like Chroma or Qdrant. This approach highlights the potential benefits of simpler data formats for improving retrieval accuracy and overall efficiency. This matters because optimizing data formats can enhance the performance and efficiency of machine learning models, particularly in resource-constrained environments.
