r/Everything_QA • u/Themythlegend-karen • 5h ago
Question Need advice on finding a research gap for our bachelor's thesis on LLM-generated software testing
Hey everyoneeee,
My teammate and I are working on our bachelor's thesis about LLMs and software testing, but we're having a hard time finding a specific research gap.Our initial idea was to compare human and LLM reviewers, but we found quite a few papers already covering this. We've also built a small tool using OpenRouter. Basically, we ask an LLM to generate test cases and its own implementation of a programming problem. Then we run those tests against correct solutions, faulty solutions, and the LLM-generated implementation to see how well the tests detect faults.The problem is that we're not really sure what research question we should focus on and what area has not been REALLY researched yet. We also considered adding a review stage where humans and LLMs improve the generated tests and comparing the results, but we're not sure if that's original enough either. We're still students, so we're not expecting to discover something groundbreaking, but we'd really like any suggestions or ideas from yall.
For anyone familiar with this area:
Are there any less-explored research directions in LLM-generated testing or fault detection?
How could we build on our current tool and turn it into a meaningful research question?
How can we actually identify a research gap when there are already so many papers on the topic?
Are there any recent papers or benchmarks worth checking out?
Any advice would be really appreciated. Thanks!