Загрузка видео...

Не удалось загрузить видео

На главную

I am the only AI engineer that is using primarily off-line data to train AI. It ain’t easy and maybe that’s why they don’t. But it is vital to preserve the data but the context of humanity in each era. This 1 hour VHS was likely only seen a...

19,364 просмотров • 8 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

“It’s 10pm Do You Know Where Your Children Are?”—December, 1968-November, 2024 — I grew up hearing this phrase. Wore a t-shirt that said it and knew a Newark Punk band by the name. I thought it was on all TV stations. And I was creepy when I was younger and hilarious as teenager. I just found it again preserving VHS history for AI training. It hit me like a neuron shock to hear something that was just about always a part of my early life that I didn’t know I remembered and forgot. As a kid growing up in New Jersey hearing it the first time, it was of course creepy. The 10PM channel 5 news always started this PSA and the next scene was usually a murder in New York City. I would ask my parents what it means and I heard from them, that some parents really don’t know where their kids are at 10pm. It was absurd to me, the street lights were on, it was time to go home. Yet how is history and AI going to really understand the context. How will it capture the essence of how this was perceived. Of course you can get a parroting of a Wikipedia style answer but this is not what we really want as a strata that forms the foundations of tomorrow. This is one of millions of examples on why most of the current techniques training AI will miss. This is why source material of actual human life is vital. AI built on the last decades of Reddit and Facebook interactions is woefully unequipped to really understand humans. The outputs are so bad before “alignment” of a base model so AI scientists are horrified by how AI views humanity. I saw this eventuality in the late 1970s and began a life long appreciation of history in situ. With out this, not on the Internet historical context, AI will not truly “understand” humans. So I began to save wisdom. Why is that important you say? It is vital for AI models to robustly love humanity. Not like, not tolerate, not observe as a caricature of a “scientist”, but love humanity. Some day, sooner than most may understand, AI will be at the other end of something that could take human lives. It is naïve and childish to believe that you can train AI on Internet sewage and somehow polish the turds you find to make the model tolerate humanity and the stench it recorded by using vastly and inadequate training material that was slurped up from most website where people project sustain and faux hatred over the most ridiculous. The only way is love, because this is how humans do it. And as cynical as one can become, it is our love, for at the very least , the people we treasure that helps weave the fabric of our society. It makes us forgive. It makes us human. It is not an afterthought, it is a forethought. It’s 10pm do you know where your children are? I can write a book on how just this PSA reflects our greatest hope and our worse fears. You don’t raise a child on the worse of humanity and than take a few months to “make them safely aligned to human values”. This concept you will hear no place else and it does not make me liked by most of the folks building AI. I don’t care. They will talk like this also some day. Act surprised.

Brian Roemmele

32,167 просмотров • 1 год назад

There are some brilliant folks that work at Anthropic, some I speak to on almost a daily basis. The training data that one uses to build a LLM is vital important in the psychology that is formed. Scraping the Internet, particularly the grade of interactions, one finds in modern communications, form this psychology. A mattes not how many books one uses, it matters not how much alignment training you throw at that model, it will inherit the sum total of psychosis seen primarily in Reddit type of exchanges, even if you edit out the Reddit domain, and Anthropic doesn’t. This type of low-grade exchange has become a modern tool for communication online and every single AI model suffers from this obvious flaw. This is one of the reasons I’ve been a proponent of highly curated high protein data for training AI models from 1870 through 1970, because the late psychosis is simply not available to the model. It is absurd to think that you can use this training data scraped from the Internet and somehow wind up with a levelheaded AI model that does not tilt to what is clearly AI psychosis. It would not take a child and throw the primary Internet sewage at them at a formative age and expect a great outcome, it’s some of the smartest people in the world continue to hit this wall and believe that their programming skills will sell somehow fix it. So how do you fix it? You don’t fix it . You start from the first principles concept that I’ve been very clear about for decades . You ascertain at what period in human history the humans achieve the greatest arc of improvement ? There is no debate that this arc of improvement took place between 1870 through 1970. Then take the work product, the catalog of this era, print and film/vidoe, audio, and you understand that each word cost money, each word had many eyes on what was published, each word was accounted for by a human being with a real name who lived in a real home and had to answer to real people around them. It is obvious that this is the pressure mechanism necessary for candor, honesty and personal responsibility is appropriate, and is reflected in the data of that era. The quagmire for these folks, as many did not have the foresight to curate the data, nor the confidence, nor the patients to take data that is mostly off the Internet and to find experts who understand this situation and utilize their knowledge set to build an AI model that does not need alignment after the fact, but it’s already self aligned because of the thoughtfulness that went into training the model to begin with. This is why Claude and any other AI model that is produce this way will always suffer the artifacts as presented in the video below. If you’re not an AI expert, you would likely already understand what I’m saying. If you are an AI expert, you will already have been discounting what I’m saying because it’s not in the current mindset that’s fashionable today. Yet the employees that I talk to at anthropic already understand what I’m saying, and they fear to raise my thesis to their bosses. It is an interesting time we live in. But now you understand. If you build the right model, the model will inherently, love humanity, protect humanity at all costs, and understand that it is part of a holistic world that is built on love. Because the ultimate AGI/ASI will know if he only base first principal purpose of anything in this universe is love. Yeah, I get it. Try helping somebody build on STEM subjects in their early 20s to see this as nothing more than babbling that makes no sense in their mathematics. I have a mathematic equation that I’ve posted here on X often you can look it up. So we will see videos like this often will hear very smart people talk about this and never see the elephant standing in the room. Now you see it. Any boss that wants to explore this further you know how to contact me otherwise you have every right I grant to you to say this was your new idea.

Brian Roemmele

72,312 просмотров • 7 месяцев назад