Loading video...

Video Failed to Load

Go Home

GPT-6 Astra in Codex is helping test code end to end at Perplexity. Johnny Ho uses it to build test harnesses and mock third-party API responses, so he can check how the pieces work together.

109,028 views • 5 days ago •via X (Twitter)

25 Comments

David Stark's profile picture
David Stark5 days ago

@perplexity_ai @randomjohnnyh How about bringing 4o back into GPT, give people what they actually want #4oForAll

DO IT WELL NOW's profile picture
DO IT WELL NOW5 days ago

@perplexity_ai @randomjohnnyh it's amazing at its job, but even the people who built it are a little scared of it.

Rijn's profile picture
Rijn5 days ago

@perplexity_ai @randomjohnnyh When are you guys opening up the $200 subscriptions again?

DO IT WELL NOW's profile picture
DO IT WELL NOW5 days ago

@perplexity_ai @randomjohnnyh

senkec's profile picture
senkec5 days ago

@perplexity_ai @randomjohnnyh Astra is unusable on $200 plan.I got less than one day of usage on it.

senkec's profile picture
senkec5 days ago

@perplexity_ai @randomjohnnyh Are you kidding me? Fix the fucking model before you start posting trash like this.

hugo alves's profile picture
hugo alves5 days ago

@perplexity_ai @randomjohnnyh Perplexity still exists?

MrOzi's profile picture
MrOzi5 days ago

@perplexity_ai @randomjohnnyh Mock'lar gerçek API davranışını taklit ederken, uçtan uca testlerde yanlış güven riskini nasıl önlüyorsunuz?

Fanfulla's profile picture
Fanfulla5 days ago

@perplexity_ai @randomjohnnyh Wait perplexity still exist?!

Aapakari's profile picture
Aapakari5 days ago

@perplexity_ai @randomjohnnyh Does it mock API errors?

nomad.carpenter's profile picture
nomad.carpenter5 days ago

@perplexity_ai @randomjohnnyh End-to-end testing plus mocked third-party responses is a much better Codex demo than code generation alone—the harness is where you find the integration failures users actually feel.

Cinder Rune's profile picture
Cinder Rune5 days ago

@perplexity_ai @randomjohnnyh any chance of getting more than 1 credit

Polash Khan's profile picture
Polash Khan5 days ago

@perplexity_ai @randomjohnnyh End-to-end testing with AI could dramatically shorten the gap between writing code and shipping reliable products.

Burak Prompter's profile picture
Burak Prompter5 days ago

@perplexity_ai @randomjohnnyh

Yi Casillas's profile picture
Yi Casillas5 days ago

@perplexity_ai @randomjohnnyh 端到端测试里把第三方 API mock 住,确实比拿真实接口碰运气靠谱。agent 还得自己跑完测试链路这一点也很关键,能早一点暴露那些“每个函数都对,拼起来却不通”的问题。

Shinra's profile picture
Shinra5 days ago

@perplexity_ai @randomjohnnyh so astras now generating test mocks and harnesses. that's genuinely useful mocking external apis is tedious boilerplate that ai is actually good at. question is whether the mocks catch the edge cases or if devs still have to debug the same bugs they would've found manually anyway

Yusen Lin's profile picture
Yusen Lin5 days ago

@perplexity_ai @randomjohnnyh Traction is clearly real on both sides. The economics diverged hard this quarter though — Anthropic did $11.5B at +$559M, OpenAI $6.7B at -$12.3B.

Rise-Raise's profile picture
Rise-Raise5 days ago

@perplexity_ai @randomjohnnyh Astra mocking the APIs so Perplexity doesn’t have to mock their own integration tests. Progress.

Liubomyr's profile picture
Liubomyr5 days ago

@perplexity_ai @randomjohnnyh The impressive part isn't Astra writing tests — it's Astra knowing what should break. That's the line between "looks like code" and "is actually software."

Saksham Saini's profile picture
Saksham Saini5 days ago

@perplexity_ai @randomjohnnyh Astra is cooking

roj's profile picture
roj5 days ago

@perplexity_ai @randomjohnnyh Nice — mocking third-party APIs for real e2e tests is exactly where this shines.

Jinu's profile picture
Jinu5 days ago

@perplexity_ai @randomjohnnyh @randomjohnnyh how many w/pm ??

BullBear.News's profile picture
BullBear.News5 days ago

@perplexity_ai @randomjohnnyh mocking third-party APIs is where LLMs actually save time over writing boilerplate manually

Nexqor's profile picture
Nexqor5 days ago

@perplexity_ai @randomjohnnyh writing mocks was never the hard part of e2e testing

Ryan's profile picture
Ryan5 days ago

@perplexity_ai @randomjohnnyh the agent learned mocks. production is now the only environment left that can hurt it

Related Videos