Published onNovember 15, 2024Generating Synthetic Data for LLM Post-TrainingaillmclassicalAn overview of the motivations and techniques used for generating synthetic data for LLM post-training, as seen in the Llama 3.1, AFM, Qwen2 and Hunyuan-Large papers.
Published onOctober 20, 2024Scaling LLM Test Time ComputeaillmclassicalAn overview of recent research on scaling test-time compute in large language models (LLMs) including CoT, STaR, ReST, RISE, ORMs, PRMs and more.
Published onAugust 18, 2024Benchmarking Python and Rust web serverspythonrustcodeclassicalComparing the performance of a simple web server implemented in Python (FastAPI & SQLAlchemy) and Rust (Rocket, Axum and Diesel).
Published onAugust 17, 2024How to build a simple web server in PythonpythoncodeclassicalA simple web server implementation in Python using FastAPI and SQLAlchemy.
Published onAugust 17, 2024How to build a simple web server in RustrustcodeclassicalTwo simple web server implementations in Rust using Rocket, axum and Diesel.
Published onJanuary 14, 2024Managing python venvs with pyenv on macOSpythoncodeclassicalLearn how to manage python virtual environments with pyenv on macOS. Optional: create a jupyter notebook kernel for your venv using ipykernel.
