Evaluation of large language model (LLM) to generate efficient Solidity code

This project provides an automated pipeline to generate smart contracts using Large Language Models with Ollama. The pipeline compiles these smart contracts with the Solidity compiler (solc), analyzes them using Slither, and performs unit testing based on the provided test instructions in the prompts. Statistics are then produced to determine the efficiency of each model and various prompts are used to interpret the results. This project aims to be accessible to all as an open source program, as the pipeline was designed and cited in the paper Benchmarking Large Language Models for Ethereum Smart Contract Development accepted for the BRAINS 2024 conference.

Source code is available on GitHub under the GNU General Public License 3.