Security Software Engineer

Il y a 6 heures

belgium belgium Braintrust Temps plein
pHelp a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security experience to work involving vulnerabilities, exploit verification and security patches. /ppThis is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the selected countries are elegible. /ph3What you will do /h3ulliEvaluate coding tasks involving software vulnerabilities, exploit verification and security patches. /liliCreate high-quality coding prompts and reference answers for benchmark-style problems. /liliEvaluate model outputs for code generation, refactoring, debugging and implementation. /liliIdentify and document model failures, edge cases and reasoning gaps. /liliCompare private language models with leading external models. /liliBuild or configure coding environments for evaluation and reinforcement learning. /liliFollow detailed annotation and evaluation guidelines consistently. /li /ulh3What you bring /h3ulliAt least five years of professional software-development experience and strong Python skills. /liliHands-on experience with vulnerability research, exploit reproduction or verification, or implementing, backporting or validating security patches. /li liThe ability to apply structured evaluation criteria and write clear technical feedback. /li liFluency in written and spoken English. /li /ulh3Helpful, not required /h3ulliProfessional code review, coding annotation, LLM/code evaluation or benchmark design. /liliKnowledge of another programming language. /liliTeam leadership or mentoring experience. /li /ul