Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

everyone is sleeping on this new JSON extraction model! - open-weights - matches Gemini Flash 3.5 - while being 3x faster pulling structured data out of documents usually takes a chain of OCR, an LLM, and extra code to repair broken JSON. lift, from Datalab, does all of this...

57,515 Aufrufe • vor 5 Tagen •via X (Twitter)

8 Kommentare

Profilbild von Jatin Garg
Jatin Gargvor 5 Tagen

@datalabto how does it handle deeply nested structures? most extraction models start hallucinating keys past 4-5 levels.

Profilbild von Winston B.
Winston B.vor 5 Tagen

@datalabto Returning null instead of guessing is the underrated part: a missing field can route to a human review queue, while a hallucinated value just flows downstream looking valid.

Profilbild von Oleg
Olegvor 5 Tagen

@datalabto 90.2% across 11,000 fields. how many invoices came back with every field right?

Profilbild von Rohan
Rohanvor 5 Tagen

@datalabto How does it handle a table that runs across two pages?

Profilbild von Daniel Priscu
Daniel Priscuvor 5 Tagen

@datalabto the ocr then llm then repair chain is where most extraction bugs come from, one model doing all of it would cut a lot

Profilbild von Reuben Fernandes ルーベン
Reuben Fernandes ルーベンvor 5 Tagen

@datalabto Returning null for missing fields is a useful detail. I’d be curious to see examples with messy tables and values that carry over between pages.

Profilbild von Aggelos Karalias
Aggelos Karaliasvor 5 Tagen

@datalabto looks abandoned? 4m in AI time is eternity!

Profilbild von AthenaIntelli AI
AthenaIntelli AIvor 5 Tagen

@datalabto Returning null when a field is missing instead of guessing is the line that sold me.

Ähnliche Videos

New Short Course: Getting Structured LLM Output! Learn how to get structured outputs from your LLM applications in this course, built in partnership with .txt, and taught by Will Kurt, a Founding Engineer, and , Developer Relations Engineer. It's challenging for software to automatically parse through an LLM's freeform text outputs. Structured outputs—like JSON—solve this by converting natural language into consistent, clear, data that a machine can read and process. This course teaches you how to generate structured outputs while building several use cases, including a social media analysis agent. You’ll learn about structured outputs and efficient ways to generate outputs in your defined schema or format. You’ll begin by using structured output APIs, then use re-prompting libraries like “instructor” to generate structured output. Finally, you’ll learn how constrained decoding works; this is a very clever technique in which constraints are applied on each subsequent token generated, blocking any tokens that don’t fit your defined schema. In detail, you’ll: - Learn why structured outputs are important, how they allow for scalable software development, and the different approaches to generate them, including vendor-provided APIs, re-prompting libraries, and structured generation. - Build a simple social media agent using OpenAI’s structured output API, learn how to define a model's desired structured output using Pydantic, and perform basic programming with your outputs, such as importing structured data into a data frame using pandas. - Learn how to use the open-source library "instructor," which checks the structured output of the model and re-prompts the model until it validates the desired output, and explore the limitations of this approach. - Understand how structured generation by the “outlines” library works by modifying LLM logits, on a per-generated-token basis based on the desired format, to give a particular output structure. - Learn how regular expressions, which outlines works with, are represented as finite-state machines, and how they can be used to develop a range of structured outputs beyond JSON. By the end of this course, you’ll have broadened your knowledge of the approaches you can use to get structured outputs from your LLM applications. Please sign up here:

Andrew Ng

89,792 Aufrufe • vor 1 Jahr

Researchers found a way to make LLMs 8.5x faster! (without compromising accuracy) Speculative decoding is quite an effective way to address the single-token bottleneck in traditional LLM inference. A small "draft" model first generates the next several tokens, then the large model verifies all of them at once in a single forward pass. If a token at any position is wrong, you keep everything before it and restart from there. This never does worse than normal decoding. But current drafters in Speculative decoding still guess one token at a time. That makes the drafting step itself a bottleneck, capping real-world speedups at 2-3x. DFlash is a new technique that swaps the autoregressive drafter with a lightweight block diffusion model that guesses all tokens in one parallel shot. Drafting cost stays flat no matter how many tokens you speculate. On top of that, the drafter is conditioned on hidden features pulled from multiple layers of the target model and injected into every draft layer, so it makes significantly better guesses than a drafter working from scratch. In the side-by-side demo below, vanilla decoding runs at 48.5 tokens/sec. DFlash hits 415 tokens/sec on the same model, with zero quality loss. It's already integrated with vLLM, SGLang, and Transformers, with draft models on HuggingFace for several models like Qwen3, Qwen3.5, Llama 3.1, Kimi-K2.5, gpt-oss, and many more. I have shared the GitHub repo in the replies! KV caching is another must-know technique to boost LLM inference. I recently wrote an article about it. Read it below. 👉 Over to you: What use case are you working on that can benefit from this new technique?

Avi Chawla

158,352 Aufrufe • vor 5 Monaten

if you are using someone else's garbage saas ai design review product, stop... all of if it is waste of time and i'll give you something better for free that runs with whatever analysis tools you want. altium-cruncher 2026.6.7 public release kicad-cruncher 2026.6.7 public release altium-cruncher is cli tool built on the altium-monkey library. (kicad-cruncher is built on kicad-monkey) here we show the "design_review" (dr) command dr converts an altium project into a simple graph-spatial-topological format specifical design for llm's - json netlist with links with detail indexes into the schematic SVG elements/groups - enriched pcb SVG heavily decorated with links back to the the json graph - all schematic notes in json form - SVG schematic/pcb elements are heirachically grouped w/ tags for the llm to build its own internal map of subcircuits with linkage to copper artwork subsections. - full part parameter linkage - an .md with a guide for codex/claude on how to step through the eviscerated project. - bonus: schdoc and pcbdoc in a raw json serialized format (what altium uses internally but doesnt give you from teh gui). this format is the literal json form of the altium format essentially all of the resolved schematic graph, physical topology, layer stack information and metadata to do make best use of current frontier and local llm techbology it actually was an accidental discovery. better than a netlist. no vendor lock-in. gives you some help without pretending its 100% . no need to waste tokens on full image processing,etc. this dataset works better, is simpler, and compatible with local llms. can help save some time and give you another set of eyes before a release. works on win/mac/linux gratis!

Eli Hughes

17,255 Aufrufe • vor 4 Monaten

Today at Yoast we’re shipping something I've actually wanted to see on the web for some time (even before working at Yoast) and am now honored to be part of the team to bring this to the masses... Built in collaboration with the Open Source and NLWeb team at Microsoft lead by R.V.Guha (co-creator of RSS, RDF and other web standards) - we're introducing the Schema Aggregation feature: a "schemamap" endpoint that outputs your site's entire structured data map in one place. ​ Under the hood, we now provide a standardised, deduplicated map of your entities via a single endpoint. An agent no longer needs to crawl all individual pages to understand its meaning but can now ingest an entire entity map with ease. ​ A few details to note about the endpoint: - It's is cacheable with sub‑100ms responses - It respects existing privacy and indexing settings - It aggregates all indexable content without navigation noise - It merges duplicate entities so your "Author X" or "Article Y" exist as a single node instead of being re‑discovered on every URL. - If you're using one of our paid plugins that extends schema even more (such as Yoast WooCommerce SEO adds product schema) this will be populated within the endpoint too - If you already extend Yoast’s Schema API, or use partners like events or recipe plugins, their entities are pulled into the same map automatically. ​ For me, this is one of the first major ways the agentic web can ingest a site at scale, and with much more efficiency and context. It has also been so much fun to work with this alongside the team at Yoast, particularly the genius mind of Alain Schlesser. Lastly, we have also launched a schema visualisation tool to view how everything is output. You can enable this feature today with the free version of Yoast SEO.

Alex Moss

15,430 Aufrufe • vor 7 Monaten

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 Aufrufe • vor 2 Jahren

Keith Rabois: “I tell founders not to worry about runway. Worry about lift.” “If you think about lift in a plane context, a company is only valuable if you achieve lift. Runway is a tactic for achieving lift, and you may need to extend the runway so that you have more time to get lift. But unless you’re actually achieving lift with that extra time, it doesn’t help you.” Keith continues: “I hate when a founder is like, ‘I want to raise this much money because it gives me two years runway.’… That is a stupid way to think about your fundraising.” Instead, founders should ask themselves what they need to achieve to achieve lift, and then work backwards from that. When Keith invests at Khosla Ventures and Founders Fund, they write internal memos about the three key risks to the company. Usually you can’t achieve all three in one financing, so founders should be asking themselves, What’s the most important inflection? And then structure their financing to achieve that. Keith advises founders that it’s ok to let their runway go very low if they feel like they’re approaching lift: “A lot of founders get very bad advice like ‘Oh, you need to have this much runway or you won’t be able to raise money from strength.’ That’s nonsense. If you have traction - if you hit a viral coefficient of 1 with three months of runway - almost every VC on the planet knows how to invest in that company, and it will not be a problem.” Video source: Khosla Ventures (2024)

Startup Archive

256,038 Aufrufe • vor 1 Jahr