CUDA / AI Engineer
Employer · MWDN
Software developerApplications developerFlexibleFull-timeBudapest
MWDN is a global IT outstaffing company with 23+ years of experience that connects exceptional tech talent with leading companies across Israel, the USA, Great Britain, and Western Europe. We are looking for a highly technical engineer or researcher with deep expertise in GPU computing, CUDA, and LLM inference optimization to work on challenging problems at the intersection of AI systems and high-performance computing.
Tasks
- Investigate and optimize LLM inference performance on modern GPUs.
- Work with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar systems.
- Analyze GPU execution, memory access patterns, kernel performance, and inference bottlenecks.
- Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU operations.
- Explore optimization techniques for matrix multiplication, attention mechanisms, and neural network layers.
- Benchmark performance and identify opportunities to improve latency, throughput, and GPU utilization.
- Work on technically challenging problems requiring strong analytical thinking and hands-on experimentation.
Conditions & benefits
SecurityWe carefully vet our clients to minimize risks and ensure reliability and timely payments - no fraud or unpleasant surprises.Career supportIf a project isn't the right fit, we support you and actively help find new opportunities that match your skills and career goals.Legal assistanceWe provide guidance on legal matters, including opening and managing your independent contractor or sole proprietorship status, taxes, and related processes.Professional developmentWe offer English courses and professional growth opportunities, as well as team-building events.Flexible working hours29 days of PTO18 working days per year plus all national holidays10 paid recovery daysFull financial and legal support for independent contractorsFree English classesWith native speakers or Ukrainian teachers
Requirements
- Strong hands-on experience with CUDA and GPU programming.
- Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization.
- Experience with LLM inference, AI systems, GPU kernels, or high-performance computing.
- Familiarity with one or more frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention.
- Experience debugging complex performance issues and investigating low-level system behavior.
- Strong problem-solving skills and the ability to communicate complex technical concepts in English.