This section details the evaluation setup for LLM code models using LuaUnit-based unit tests, measuring metrics such as pass@1, inference time, LOC, and error types to understand how quantization affects model accuracy and behavior.
Q2BSTUDIO is a technology development and services company that specializes in custom applications and custom software. We offer solutions in artificial intelligence, cybersecurity, AWS and Azure cloud services, as well as business intelligence and Power BI services to meet our clients' needs.
