CUDA Engineer
Employer · MWDN
Software developerFlexibleFull-timeBudapest
MWDN is a global IT outstaffing company looking for a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to work on challenging problems at the intersection of AI systems and high-performance computing.
Tasks
- Investigate and optimize LLM inference performance on modern GPUs.
- Work with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems.
- Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks.
- Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations.
- Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers.
- Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization.
- Work on technically challenging problems requiring strong analytical thinking and hands-on experimentation.
Conditions & benefits
SecurityCarefully vetted clients to ensure reliability and timely payments.Career supportActive help to find new opportunities that match your skills if a project isn't the right fit.Legal assistanceGuidance on legal matters, contractor status, taxes, and related processes.Professional developmentEnglish courses, professional growth opportunities, and team-building events.Flexible working hours29 days of PTO18 working days per year plus all national holidays.10 paid recovery days
Requirements
- Strong hands-on experience with CUDA and GPU programming.
- Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization.
- Experience with LLM inference, AI systems, GPU kernels, or high-performance computing.
- Familiarity with one or more frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention.
- Experience debugging complex performance issues and investigating low-level system behavior.
- Strong problem-solving skills and the ability to communicate complex technical concepts in English.