CUDA Engineer
Employer · MWDN
Software developerApplications developerFlexibleFull-timeBudapest
MWDN is a global IT outstaffing company looking for a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to work on challenging problems at the intersection of AI systems and high-performance computing.
Tasks
- Investigate and optimize LLM inference performance on modern GPUs.
- Work with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems.
- Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks.
- Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations.
- Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers.
- Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization.
- Work on technically challenging problems requiring strong analytical thinking and hands-on experimentation.
Conditions & benefits
People-first managementPeople-first management with minimal bureaucracyCompany cultureA friendly company culture, proven by employees who choose to returnFlexible working hoursFlexible working hoursPTO29 days of PTO (18 working days per year plus all national holidays)Recovery days10 paid recovery daysLegal and financial supportFull financial and legal support for independent contractorsEnglish classesFree English classes, with native speakers or Ukrainian teachersHR supportDedicated HR support
Requirements
- Strong hands-on experience with CUDA and GPU programming.
- Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization.
- Experience with LLM inference, AI systems, GPU kernels, or high-performance computing.
- Familiarity with one or more frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention.
- Experience debugging complex performance issues and investigating low-level system behavior.
- Strong problem-solving skills and the ability to communicate complex technical concepts in English.