Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I just created my own OCR app using Llama 3.2 vision! Upload an image, and it converts it into structured markdown using Llama 3.2 multimodal! Here's what I used: - Ollama for serving Llama 3.2 vision locally. - Streamlit for the UI. Everything in just 50 lines of code!... show more

Avi Chawla

67,098 subscribers

131,139 views • 1 year ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

Avi Chawla1 year ago

Code:

Matias Perelli1 year ago

I recorded a 31-minute video on how 7-8 figure eCom brands can add $143k using 3 Klaviyo "tweaks". Watch the exact method we used recently with a client. Click below.

Ivan Fioravanti ᯅ1 year ago

Show me the code 🤣

Avi Chawla1 year ago

Here you go:

hoka1 year ago

Bro why

Avi Chawla1 year ago

Akshay and I are co-founders of the same newsletter. So we work together.

remy1 year ago

Not as pretty but I actually did one last night to help someone. One shot ~ich with Cursor. :-)

Paul Lemaistre1 year ago

Why not use stepfun-ai/GOT-OCR2_0? As far as I know it’s SOTA

Jayson Gent1 year ago

@akshay_pachaar Awesome! Didn't even know a vision model was available. I need more vram..

Hemant C. Sharma1 year ago

Can anyone give me a solution that will run locally on a mobile app, without needing to connect. Thank you in advance

jatin1 year ago

Product idea: Integrate with Concur and other expense filing platforms. Extract this data as a json and pass it on to their API to automatically file expenses.

Related Videos

Build your own local ChatGPT-like interface! Powered by Llama 3.2 Vision, it runs 100% locally and supports: ↳Text chat ↳Chat with images Tech stack: ↳ Chainlit for the UI ↳ Ollama for serving Llama 3.2 vision Everything is just 50 lines of code! I have shared link to the code in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Build your own local ChatGPT-like interface! Powered by Llama 3.2 Vision, it runs 100% locally and supports: ↳Text chat ↳Chat with images Tech stack: ↳ Chainlit for the UI ↳ Ollama for serving Llama 3.2 vision Everything is just 50 lines of code! I have shared link to the code in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Akshay 🚀

49,952 views • 1 year ago

I just built my own OCR app powered by Google's Gemma 3. It runs 100% locally on my computer using Ollama and extracts text from images as structured markdown. The code is open-source, and you can find it in the next tweet.

I just built my own OCR app powered by Google's Gemma 3. It runs 100% locally on my computer using Ollama and extracts text from images as structured markdown. The code is open-source, and you can find it in the next tweet.

Akshay 🚀

477,685 views • 1 year ago

$I just added the new Llama 3.2 1B and 3B models to LitGPT, the open-source LLM library I help develop (focused on efficiency and code readability). LitGPT allows you to fine-tune and use these models on the cloud or a laptop. So, if you are looking for something to play with this weekend: # 1) Finetune the model litgpt finetune_lora meta-llama/Llama-3.2-1B \ --data JSON \ --data.json_path my_custom_dataset.json \ --train.epochs 1 \ --out_dir out/llama-3.2-finetuned \ --precision bf16-true # 2) Chat with the model litgpt chat out/llama-3.2-finetuned/final # 3) Serve the model via an API endpoint litgpt serve out/llama-3.2-finetuned/final$

I just added the new Llama 3.2 1B and 3B models to LitGPT, the open-source LLM library I help develop (focused on efficiency and code readability). LitGPT allows you to fine-tune and use these models on the cloud or a laptop. So, if you are looking for something to play with this weekend: # 1) Finetune the model litgpt finetune_lora meta-llama/Llama-3.2-1B \ --data JSON \ --data.json_path my_custom_dataset.json \ --train.epochs 1 \ --out_dir out/llama-3.2-finetuned \ --precision bf16-true # 2) Chat with the model litgpt chat out/llama-3.2-finetuned/final # 3) Serve the model via an API endpoint litgpt serve out/llama-3.2-finetuned/final

Sebastian Raschka

65,529 views • 1 year ago

Llama 3.2 features 11B & 90B models, our first multimodal Llama models with support for vision tasks. These models can take in both image and text prompts to deeply understand and reason on inputs.

Llama 3.2 features 11B & 90B models, our first multimodal Llama models with support for vision tasks. These models can take in both image and text prompts to deeply understand and reason on inputs.

AI at Meta

121,530 views • 1 year ago

Announcing An open source wireframe to app tool powered by Llama 3.2 vision. Upload a screenshot of a simple site/design & get code. 100% free and open source.

Announcing An open source wireframe to app tool powered by Llama 3.2 vision. Upload a screenshot of a simple site/design & get code. 100% free and open source.

Hassan

185,882 views • 1 year ago

I just created an agentic-workflow to automatically write and publish content for me! It's powered by CrewAI Flows and Llama 3.2, running 100% locally. Tech stack: - CrewAI to build an agentic workflow - FireCrawl for web scraping - Typefully for scheduling Here's how it works: - You provide a link to a website. - It scrapes and saves the data as markdown. - A router triggers the desired Crew of agents. - The Crew prepares a ready-to-publish draft. - Finally, use Typefully to post it to your socials. Totally hands-off and 100% automated! In this video, I provide a deep dive into how it actually works! Find the link to all the code in the next tweet! Enjoy the video! 🥂

I just created an agentic-workflow to automatically write and publish content for me! It's powered by CrewAI Flows and Llama 3.2, running 100% locally. Tech stack: - CrewAI to build an agentic workflow - FireCrawl for web scraping - Typefully for scheduling Here's how it works: - You provide a link to a website. - It scrapes and saves the data as markdown. - A router triggers the desired Crew of agents. - The Crew prepares a ready-to-publish draft. - Finally, use Typefully to post it to your socials. Totally hands-off and 100% automated! In this video, I provide a deep dive into how it actually works! Find the link to all the code in the next tweet! Enjoy the video! 🥂

Akshay 🚀

98,126 views • 1 year ago

Run AI Agents locally in your terminal using Llama 3.2! gptme: Run Code, edit files, browse the web, and add context with RAG - all from your terminal. 100% Open Source.

Run AI Agents locally in your terminal using Llama 3.2! gptme: Run Code, edit files, browse the web, and add context with RAG - all from your terminal. 100% Open Source.

Sumanth

78,860 views • 1 year ago

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 views • 1 year ago

Ollama Supports Llama 3.2 Vision: Talk to ANY Image 100% Local! 📚 Step-by-step Hands-on tutorial ⚡ How to Install? ollama 🏃‍♂️ How to Run? Meta @aiatmeta 🔌 How to Integrate in your App? 🎮 How to Create UI? Chainlit 📈 Analyse charts and graphs

Ollama Supports Llama 3.2 Vision: Talk to ANY Image 100% Local! 📚 Step-by-step Hands-on tutorial ⚡ How to Install? ollama 🏃‍♂️ How to Run? Meta @aiatmeta 🔌 How to Integrate in your App? 🎮 How to Create UI? Chainlit 📈 Analyse charts and graphs

Mervin Praison

39,391 views • 1 year ago

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 views • 1 year ago

Llama 3.2 can do selective image editing, and it’s really impressive!

Llama 3.2 can do selective image editing, and it’s really impressive!

AshutoshShrivastava

247,292 views • 1 year ago

"Introducing Multimodal Llama 3.2": As promised two weeks ago, here's the short course on Meta's latest open model! This short course is created with Meta and taught by Amit Sangani, Director of AI Partner Engineering at Meta. Meta’s Llama family of models is leading the way in open models, allowing anyone to download, customize, fine-tune, or build new applications on top of them. Learn about the vision capabilities of the Llama 3.2, and use it for image classification, prompting, tokenization, tool-calling. You'll also learn about the open-source Llama stack, which gives building blocks for many different stages of the LLM application life cycle. In detail, you’ll: - Learn what are the features of Meta's four newest models, and when to use which Llama model. - Learn best practices for multimodal prompting, with applications to advanced image reasoning, illustrated by many examples: Understanding errors on a car dashboard, adding up the total of photographed restaurant receipts, grading written math homework. - Use different roles—system, user, assistant, ipython—in the Llama 3.1 and 3.2 models and the prompt format that identifies those roles. - Understand how Llama uses the tiktoken tokenizer, and how it has expanded to a 128k vocabulary size that improves encoding efficiency and multilingual support. - Learn how to prompt Llama to call built-in and custom tools (functions) with examples for web search and solving math equations. - Learn about Llama Stack, a standardized interface for common toolchain components like fine-tuning or synthetic data generation, useful for building agentic applications. By the end of this course, you’ll be equipped to build out new applications with the new Llama 3.2. Thank you to Ahmad Al-Dahle, Amit Sangani, and the whole AI at Meta team AI at Meta for all the hard work on Llama 3.2 — we’re excited to make these open models even more accessible to more developers with this new course! Please sign up here!

"Introducing Multimodal Llama 3.2": As promised two weeks ago, here's the short course on Meta's latest open model! This short course is created with Meta and taught by Amit Sangani, Director of AI Partner Engineering at Meta. Meta’s Llama family of models is leading the way in open models, allowing anyone to download, customize, fine-tune, or build new applications on top of them. Learn about the vision capabilities of the Llama 3.2, and use it for image classification, prompting, tokenization, tool-calling. You'll also learn about the open-source Llama stack, which gives building blocks for many different stages of the LLM application life cycle. In detail, you’ll: - Learn what are the features of Meta's four newest models, and when to use which Llama model. - Learn best practices for multimodal prompting, with applications to advanced image reasoning, illustrated by many examples: Understanding errors on a car dashboard, adding up the total of photographed restaurant receipts, grading written math homework. - Use different roles—system, user, assistant, ipython—in the Llama 3.1 and 3.2 models and the prompt format that identifies those roles. - Understand how Llama uses the tiktoken tokenizer, and how it has expanded to a 128k vocabulary size that improves encoding efficiency and multilingual support. - Learn how to prompt Llama to call built-in and custom tools (functions) with examples for web search and solving math equations. - Learn about Llama Stack, a standardized interface for common toolchain components like fine-tuning or synthetic data generation, useful for building agentic applications. By the end of this course, you’ll be equipped to build out new applications with the new Llama 3.2. Thank you to Ahmad Al-Dahle, Amit Sangani, and the whole AI at Meta team AI at Meta for all the hard work on Llama 3.2 — we’re excited to make these open models even more accessible to more developers with this new course! Please sign up here!

Andrew Ng

131,606 views • 1 year ago

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Shubham Saboo

73,631 views • 1 year ago

Inspired by this tweet, I built my own locally running typing assistant with Ollama and Mistral 7B. It only took ~100 lines of Python code and works really well! I also created a video with step-by-step explanations: - Code: - Blog post: - Coding tutorial:

Inspired by this tweet, I built my own locally running typing assistant with Ollama and Mistral 7B. It only took ~100 lines of Python code and works really well! I also created a video with step-by-step explanations: - Code: - Blog post: - Coding tutorial:

Patrick Loeber

161,584 views • 2 years ago

$Fuck it! You can now run *any* GGUF on the Hugging Face Hub directly with ollama 🔥 This has been a constant ask from the community, starting today you can point to any of the 45,000 GGUF repos on the Hub* *Without any changes whatsoever! ⚡ All you need to do is: ollama run hf. co/{username}/{reponame}:latest For example, to run the Llama 3.2 1B, you can run: ollama run hf. co/bartowski/Llama-3.2-1B-Instruct-GGUF:latest If you want to run a specific quant, all you need to do is specify the Quant type: ollama run hf. co/bartowski/Llama-3.2-1B-Instruct-GGUF:Q8_0 That's it! We'll work closely with Ollama to continue developing this further! ⚡$

Fuck it! You can now run any GGUF on the Hugging Face Hub directly with ollama 🔥 This has been a constant ask from the community, starting today you can point to any of the 45,000 GGUF repos on the Hub* *Without any changes whatsoever! ⚡ All you need to do is: ollama run hf. co/{username}/{reponame}:latest For example, to run the Llama 3.2 1B, you can run: ollama run hf. co/bartowski/Llama-3.2-1B-Instruct-GGUF:latest If you want to run a specific quant, all you need to do is specify the Quant type: ollama run hf. co/bartowski/Llama-3.2-1B-Instruct-GGUF:Q8_0 That's it! We'll work closely with Ollama to continue developing this further! ⚡

Vaibhav (VB) Srivastav

317,790 views • 1 year ago

First-ever ChatGPT-like playground for AI Agents that works with Claude Sonnet 3.5, GPT-4o, local Llama 3.2 and other LLMs (100% opensource and free).

First-ever ChatGPT-like playground for AI Agents that works with Claude Sonnet 3.5, GPT-4o, local Llama 3.2 and other LLMs (100% opensource and free).

Shubham Saboo

108,667 views • 1 year ago