Judge0

Established in August 2016.

Code execution made simple for every business.

Robust, fast, scalable, and sandboxed open-source online code execution system for humans and AI.

About
Features
Get Started
Flavors
Citation
References
Showcase
Community
Author and Contributors
Changelog
Special Thanks
License

About

Judge0 (pronounced like "judge zero") is a robust, scalable, and open-source online code execution system. You can use it to build a wide range of applications that need online code execution features. Some examples include AI agents, competitive programming platforms, e-learning platforms, candidate assessment and recruitment platforms, online code editors, online IDEs, and many more.

Judge0 is an open-source online code execution system that enables the robust, fast, scalable, and sandboxed execution of AI-generated code, with support for multiple languages and frameworks.

In our research paper Robust and Scalable Online Code Execution System, we present Judge0's modern modular architecture that can be easily deployed and scaled. We study its design, comment on the various challenges in building such systems, and compare it with other available online code execution systems and online judge systems.

To see Judge0 in action, try Judge0 IDE - our free and open-source online code editor.

Features

Self-hostable or fully managed (SaaS)
Quick and easy self-hosting installation
Rich and verbose API documentation
Simple HTTP JSON API for easy integration
Official Python SDK for easy integration
Scalable architecture for handling high loads
Sandboxed compilation and execution of untrusted code
Support for 90+ languages (see the full list of supported languages)
Compilation and execution of multi-file programs (i.e. projects)
Support for additional files alongside the single-file user's program
Support for custom user-defined compiler options, command-line arguments, and time and memory limits
Detailed execution results
Webhooks (HTTP callbacks)

For more information about these and other features, please read the documentation.

Get Started

You have plenty of options to get started with Judge0:

Integrating Judge0 into your application is easy. You can either use our simple HTTP JSON API or use our official Python SDK.

HTTP JSON API

curl \
  -H "Content-Type: application/json" \
  -d '{
      "language_id": 109,
      "source_code": "print(f\"hello, {input()}\")",
      "stdin": "Alice"
  }' \
  "https://ce.judge0.com/submissions?wait=true"

Python SDK

# pip install judge0
import judge0
result = judge0.run(source_code="print(f'hello, {input()}')", stdin="Alice", language=judge0.PYTHON)
print(result.stdout)

Flavors

Judge0 comes in two flavors: Judge0 CE and Judge0 Extra CE. They differ mostly in the supported languages.

You can find the source code for Judge0 CE on the master branch, while you can find the source code for Judge0 Extra CE on the extra branch.

Citation

Please cite us if you use Judge0 in your research:

@INPROCEEDINGS{9245310,
  author={Došilović, Herman Zvonimir and Mekterović, Igor},
  booktitle={2020 43rd International Convention on Information, Communication and Electronic Technology (MIPRO)},
  title={Robust and Scalable Online Code Execution System},
  year={2020},
  volume={},
  number={},
  pages={1627-1632},
  keywords={Production systems;Operating systems;Systems architecture;Computer architecture;Programming profession;Open source software;Recruitment;online code execution system;online judge system;untrusted code execution},
  doi={10.23919/MIPRO48935.2020.9245310}
}

Judge0

Install / Use

README

Judge0

Table of Contents

About

Features

Get Started

HTTP JSON API

Python SDK

Flavors

Citation

References

Industry

Academia