Using Codex to Create a Node.js Web Application Boilerplate
The simplest route is a full-stack Next.js application. It runs on Node.js while keeping the pages, authentication, API routes, and styling in
Getting Started with OpenAI Codex
A strong way to use Codex for this is to make AGENTS.md define the architecture and engineering rules, then give Codex small issue-style
How a Transformer Layer Maps to GPU Memory
The key is to think of vLLM GPU memory as a budget shared by several very different kinds of data. Some memory is essentially
How an LLM Works with an Inference Engine
A useful way to understand an LLM is to separate it into four pieces: architecture + weights + tokenizer + runtime configuration. An inference engine such as
SOP Benchmark vLLM Models Using LiveBench
1. Purpose This SOP describes how to use LiveBench to evaluate model quality through a production-style vLLM OpenAI-compatible API. Environment: ComponentConfigurationInference EnginevLLMAPIOpenAI-compatibleEndpointhttps://dev-va-vllm.eveon.
SOP Production vLLM Deployment on AWS EC2 with ALB
1. Purpose This SOP describes a secure and production-ready deployment of vLLM on Amazon Linux 2023, using an NVIDIA GPU-based EC2 G6 or newer
SOP - Deploying vLLM on Amazon Linux
Version: 1.0 Platform: Amazon Linux 2023 Deployment Method: Docker (Recommended) Audience: System Administrators, DevOps Engineers, AI/ML Engineers 1. Purpose This document describes
AWS EC2 Instance GPU Types
AWS EC2 GPU Instance Comparison FeatureAmazon EC2 G5Amazon EC2 G6Amazon EC2 G7Processor2nd-generation AMD EPYC processorsNewer-generation processors optimized for GPU workloadsCustom Intel Xeon 6 processorsGPUUp
SOP Running and Configuring vLLM on Linux using Docker
Document Version: 1.0 Applies To: Ubuntu 22.04/24.04, Debian 12, RHEL/Rocky 9 (or equivalent Linux distributions) Model: google/gemma-4-12B-it (recommended)
SOP: Install Open WebUI on Linux Using Docker Compose
1. Purpose This SOP describes how to install and configure Open WebUI on a Linux server using Docker Compose. The deployment supports: * Connection to
SOP: Ollama Installation and Configuration
1. Purpose This SOP provides instructions for installing and configuring Ollama on a Linux server, enabling remote access, verifying the service, and downloading an
Employee Onboarding and Offboarding Process
Below is a typical enterprise employee onboarding and offboarding process covering HR, IT, Security, Facilities, Finance, Legal, and the employee’s manager. 1. Employee