Gezinmeyi atla
The first open-source implementation of the paper that will change automatic test generation is now…
0:00 / 1:05

The first open-source implementation of the paper that will change automatic test generation is now…

Santiago

@svpino457 B takipçi

X profili
3.389 beğeniİndirOrijinal gönderi

774.857 görüntüleme

The first open-source implementation of the paper that will change automatic test generation is now available! In February, Meta published a paper introducing a tool to automatically increase test coverage, guaranteeing improvements over an existing code base. This is a big deal, but Meta didn't release the code. Fortunately, we now have Cover-Agent, an open-source tool you can install that implements Meta's paper to generate unit tests automatically: I recorded a quick video showing Cover-Agent in action. There are two things I want to mention: 1. Automatically generating unit tests is not new, but doing it right is difficult. If you ask ChatGPT to do it, you'll get duplicate, non-working, and meaningless tests that don't improve your code. Meta's solution only generates unique tests that run and increase code coverage. 2. People who write tests before writing the code (TDD) will find this less helpful. That's okay. Not everyone does TDD, but we all need to improve test coverage. There are many good and bad applications of AI, but this is one I'm looking forward to make part of my life.

10 Yorum

Yorumlar X (Twitter) üzerindeki orijinal gönderiden alınmıştır

  • Itamar Friedman profil fotoğrafı

    @itamar_mar

    Hey 👋, one of the Cover-Agent creators here. I've recorded 5 minutes video explaining and reviewing TestGen-LLM and Cover-Agent:

    321 beğeni

  • Santiago profil fotoğrafı

    @svpino

    Great job and thank you!

    27 beğeni

  • Sam Francisco profil fotoğrafı

    @CometThief

    It's 630 why are you giving me more work already Santiago I haven't even had my coffee yet

    15 beğeni

  • Santiago profil fotoğrafı

    @svpino

    lol

    2 beğeni

  • Alex Dillon | Quality Advocate profil fotoğrafı

    @masterpiece91

    As someone very much involved in testing, this is quite interesting to me. I want to look more into it and explore the quality of the tests. Though, I’m a bit skeptical that this will be replacing someone having to write these tests, the hope is that it at least provides a good starting point for someone.

    5 beğeni

  • Graham Cox (@grahamcox82.bsky.social) profil fotoğrafı

    @grahamcox82

    I'm curious - how does the tool know what the correct behaviour is? Or does it assume that the current implementation is already correct? (Which, to be fair, is how things like Jest snapshots work anyway)

    4 beğeni

  • Shikhar Srivastava profil fotoğrafı

    @shikhar_sri

    As someone who doesn’t like TDD..

    3 beğeni

  • Pradeep Gowda profil fotoğrafı

    @btbytes

    @ponnappa fyi

    2 beğeni

  • Markus Odenthal profil fotoğrafı

    @MarkusOdenthal

    This can be especially helpful for ML projects. I usually write tests when I bring my product to production, not when starting the project. So this would be a huge time-saver, thanks for sharing.

    2 beğeni

  • SwissTechMind profil fotoğrafı

    @SwissTechMind

    So, if I understand correctly, the primary purpose of these tests is to safeguard against unintentional changes, right?

    2 beğeni