Andrei Aksionau

Background

About Andrei Aksionau

Passionate machine learning engineer with expertise in semantic text search and large language models. Proven track record of contributing to open-source projects and driving optimizations for state-of-the-art large language models. Strong background in designing and implementing text classification, vectorization, and semantic search models, with a focus on efficiency and performance.Current ProjectsLit-GPT Contributor | July 2023 – now- Top-5 contributor for Lit-GPT (10k+ stars)- Hackable implementation of state-of-the-art open-source LLMs- Work on model optimizations, parameter efficient fine-tuning, quantization, and code annotations for newcomers- Collaborated with core maintainers to add low-ranking adaptation, 4bit quantization and efficient GPU utilization, resulting in lowering hardware requirements for model fine-tuning- GitHub link: https://github.com/Lightning-AI/lit-gptnanoGPTPlus Project | January 2023 – July 2023- Personal project extending nanoGPT by Andrej Karpathy- Improving readability and suitability for production- ML cookie-cutter project structure, documentation of model architectures, tests, and CI jobs- GitHub link: https://github.com/Andrei-Aksionov/nanoGPTplus