Thursday, May 30, 2024

A hazard evaluation framework for code synthesis massive language fashions

Must read


Codex, a big language mannequin (LLM) skilled on quite a lot of codebases, exceeds the earlier cutting-edge in its capability to synthesize and generate code. Though Codex supplies a plethora of advantages, fashions which will generate code on such scale have vital limitations, alignment issues, the potential to be misused, and the likelihood to extend the speed of progress in technical fields which will themselves have destabilizing impacts or have misuse potential. But such security impacts will not be but identified or stay to be explored. On this paper, we define a hazard evaluation framework constructed at OpenAI to uncover hazards or security dangers that the deployment of fashions like Codex could impose technically, socially, politically, and economically. The evaluation is knowledgeable by a novel analysis framework that determines the capability of superior code technology strategies towards the complexity and expressivity of specification prompts, and their functionality to grasp and execute them relative to human capacity.



Supply hyperlink

More articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest article