Talent.com
ITRex Group
AI Inference Engineer (f/m/d)ITRex Group • Bucharest, RO
AI Inference Engineer (f/m/d)

AI Inference Engineer (f/m/d)

ITRex Group • Bucharest, RO
În urmă cu peste 30 de zile
Tip loc de muncă
  • Quick Apply
Descrierea postului

About ITRex

THE PLACE

ITRex - AI pioneers who build systems that actually work in the real world, not just in demos. We're 250+ people spread across the US and Europe, creating solutions for companies like Procter & Gamble and Shutterstock. We keep it simple, build it right, and focus on what works.

THE PEOPLE

We're the kind of people who don't ignore messages in Slack, who jump in to help when you're stuck on a problem, and who offer solutions instead of blame when things go sideways. We believe in openness, accountability, and having each other's backs. No office politics, no hidden agendas - just people who care about doing good work together and supporting each other to get there.

THE ROLE

We are looking for a strong C++ Engineer with hands-on experience deploying and optimizing modern AI models for production. The ideal candidate combines deep systems programming expertise with practical experience working with LLMs and modern deep learning architectures. Rather than building or training models from scratch, this engineer focuses on integrating, evaluating, profiling, and optimizing AI inference pipelines for high-performance on-device execution.

Responsibilities

  • Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml
  • Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments
  • Integrate AI features into existing products, enriching them with the latest advancements in machine learning

Requirements

Core Software Engineering

    • 4+ years of professional experience in Modern C++ (C++17/20)
    • Strong knowledge of memory management, multithreading, profiling and performance optimization
    • Experience debugging low-level issues (memory leaks, fragmentation, OOM, concurrency)
    • Experience working with Linux development environments

AI Inference / ML Systems

    • Experience integrating machine learning models into production applications
    • Experience deploying and optimizing AI inference pipelines
    • Hands-on experience with AI inference frameworks such as: llama.cpp (strong plus), ggml (strong plus), ONNX Runtime, TensorRT / TensorRT-LLM, OpenVINO, MLC LLM, ExecuTorch, TVM
    • Experience profiling inference performance and optimizing memory usage and latency

Deep Learning Knowledge

Strong understanding of modern AI model architectures, including:

    • Transformer architecture
    • Large Language Models (LLMs)
    • Diffusion Models
    • Tokenization
    • Attention mechanisms
    • KV Cache
    • Quantization techniques
    • Model conversion and deployment

Practical AI Experience

    • Experience working with one or more of the following: LLM deployment, Computer Vision models, OCR models, Multimodal models, Speech models, Image generation models
    • Experience evaluating new models and integrating them into existing products is highly desirable

Nice to Have

    • CUDA
    • Vulkan Compute
    • Metal
    • OpenCL
    • Typescript
    • Python
    • Experience contributing to open-source AI infrastructure projects

Benefits

Why people stay

First, the foundation:

  • Remote flexibility: Work where and how you work best - we trust you to deliver
  • Fair compensation: Competitive salary + benefits that matter (medical, learning)

Then, the growth:

  • Ownership opportunities: See a problem worth solving? Own it. We back smart risks over bureaucratic safety
  • AI enhancement: We leverage AI to make you faster and stronger - complementing your abilities, not replacing them
  • Learning investment: English classes, professional development
  • Career progression: Real paths up, not just sideways shuffling


Finally, the people:

  • Responsive teammates: No ignored Slacks, no "not my problem" attitudes
  • Supportive culture: When you're stuck, people help. When things break, we fix them together
  • Human connections: Regular meetups, tech talks, and actual relationships beyond work


Curious? We are too. Let's talk

Creați o alertă de locuri de muncă pentru această căutare

AI Inference Engineer (f/m/d) • Bucharest, RO

Locuri de muncă similare

AI Research Engineer (Agentic Posttraining) 100% Remote Worldwide

Tether Operations LimitedBucharest, B, RO

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Afișați mai multe

CI/CD Engineer

Urban ConnectBucharest, Romania
Quick Apply

Hibrid in Bucharest, 2 days WFO.We are part of a technology and software engineering centre in Bucharest, Romania, delivering mission-critical solutions for a leading global financial institution.O... Afișați mai multe

Lead AI Application Engineer (Infrastructure & LLMOps)

TechBiz Global GmbHBucuresti, B, RO

At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.We are currently looking for a dedicated.If you're looking for an exciting opportunity to grow in an in... Afișați mai multe

Design Verification Engineer

Sales ConsultingBucurești, București, Romania

As Design Verification Engineer, you will join leading-edge team responsible for the verification of advanced interconnect systems in state-of-the-art microprocessors.This role focuses on ensuring ... Afișați mai multe

Data Quality Engineer (Python & Databricks)

AIDA RecruitmentBuharest, Romania
Quick Apply

Data Quality Engineer (Python & Databricks).In this role, you will be responsible for designing and maintaining automated data validation frameworks that ensure data consistency, accuracy, and ... Afișați mai multe

Data Quality Risk Supervisor

Sales ConsultingBucurești, București, Romania

Data Quality Risk Supervisor – Independent Assessment.First Line of Defense (1LOD) frameworks and practices related to data quality risk.You will apply established methodologies to challenge how 1L... Afișați mai multe

Senior Java Engineer - Data & Analytics

Urban ConnectBucharest, Romania
Quick Apply

Hibrid in Bucharest, 2 days WFO.About the Organisation & Team.We are a technology and software engineering centre based in Bucharest, Romania, delivering global technology products and services... Afișați mai multe

Senior Verification Engineer

TechBiz Global GmbHBucharest, B, RO

At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.If you're looking for an exciting opportunity to grow in a innovative environment, this could be the pe... Afișați mai multe

Senior Data Engineer / Analyst

Sales ConsultingBucurești, București, Romania

Our customer is a top-tier investment bank with client assets of hundreds of billion globally.We offer the opportunity to work in a highly professional environment where you will work with high-lev... Afișați mai multe

AI Research Engineer (Kernel & Inference Optimization) 100% Remote Worldwide

Tether Operations LimitedBucharest, B, RO

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Afișați mai multe

 • Ofertă nouă!

AI Research Engineer (MultiModal Reinforcement Learning) 100% Remote Worldwide

Tether Operations LimitedBucharest, B, RO

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Afișați mai multe

Regular Data Engineer

Sales ConsultingBucurești, București, Romania

The role involves sourcing data from multiple systems, optimizing workflows and collaborating with architects and analysts to deliver clean, well-structured datasets.Proficiency in SQL and Python o... Afișați mai multe

AI Research Engineer (MultiModal & Vision) 100% Remote Worldwide

Tether Operations LimitedBucharest, B, RO

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Afișați mai multe

Quantitative Developer / AI & Automation Specialist – Power Trading

Sales ConsultingBucurești, București, Romania

Develop AI models for forecasting consumption and production, including renewables;.Build predictive models for prices in DAM, IDM, and BRM markets;.Forecast imbalances and associated costs using a... Afișați mai multe

Senior AI Engineer (Python)

Sales ConsultingBucurești, București, Romania

The role focuses on building and optimizing AI solutions by integrating data from multiple systems and collaborating with architects and analysts to deliver high-quality dataset.Implement NLP Solut... Afișați mai multe

Senior Data Engineer — BigQuery & Analytics

Urban ConnectBucharest, Romania
Quick Apply

Hibrid in Bucharest, 2 days WFO.You will join the Data & Analytics stream, responsible for management reporting, regulatory & risk reporting, and advanced analytics.Our mission includes enh... Afișați mai multe

Cyber Risk Analyst – AI

Urban ConnectBucharest, Romania
Quick Apply

The Cyber Risk Analyst is also a subject matter expert leveraging a deep understanding of the enterprise risk discipline and regulatory compliance combining deep knowledge of theory and organizatio... Afișați mai multe

Digital Analytics Engineer

TransPerfectBucharest, B, RO

At Avatria, we specialize in bringing world-class Digital Commerce, Content, and Analytics solutions to our customers.We are sharp, hands-on technologists with a genuine love for all things digital... Afișați mai multe

DevOps Engineer - AI Model Evaluator

MercorBucharest, Bucharest, Romania
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Afișați mai multe

AI Lead - Developer Productivity

EveryMatrixBucurești, București, Romania

EveryMatrix is a leading B2B SaaS provider delivering iGaming software, content and services.We provide casino, sports betting, platform and payments, and affiliate management to 300 customers worl... Afișați mai multe