CUDA / AI Engineer
Employer · MWDN
Budapest
MWDN is a global IT outstaffing company with 23 years of experience. We're looking for a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to work on challenging problems at the intersection of AI systems and high-performance computing.
Tasks
- Investigate and optimize LLM inference performance on modern GPUs.
- Work with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems.
- Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks.
- Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations.
- Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers.
- Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization.
- Work on technically challenging problems requiring strong analytical thinking and hands-on experimentation.