Back to Remote jobs >
Software Development
Edge AI Staff Engineer
@Extremenetworks
[Hiring] Edge AI Staff Engineer @Extremenetworks
Apr 09, 2025 - Extremenetworks is hiring a remote Edge AI Staff Engineer. 💸 Salary: unspecified. 📍Location: Canada.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
We are seeking a talented Edge AI Staff Engineer with specialized expertise in GPU/TPU acceleration to join our team. The ideal candidate will have extensive hands-on experience in local Large Language Models (LLM) inference with embedded GPU/TPU architectures. As Staff Engineer specializing in Edge AI, you will play a crucial role in shaping the future Edge AI solution, leveraging the power of GPU/TPU acceleration and enterprise grade, large scale edge compute. The successful candidate will combine technical excellence with effective leadership, creating a positive impact on both projects and team dynamics.
Key Responsibilities
- Influence the Edge AI strategy by providing expert advice on design and architecture.
- Make critical decisions regarding technical directions, scalability, and system performance.
- Develop and optimize AI inference models for deployment on edge devices with embedded GPU/TPU accelerators, focusing on local Low Latency Model (LLM) inference.
- Implement and fine-tune low-latency model inference pipelines to meet real-time performance requirements.
- Collaborate with cross-functional teams to integrate AI inference solutions into edge computing platforms and applications.
- Collaborate with the GPU Hardware Design Team to design and optimize GPUs that power next-generation devices.
- Conduct performance profiling and optimization to maximize the efficiency of GPU/TPU acceleration for local LLM inference.
- Work on micro-architecture development, ensuring efficient execution of graphics, compute, and AI workloads within energy and area constraints.
- Stay current with advancements in GPU/TPU technologies and edge AI frameworks, incorporating them into solution designs as appropriate.
- Provide technical expertise and support to project teams, ensuring successful implementation and deployment of edge AI solutions.
Team Leadership
- Lead and inspire a team of engineers, providing guidance, setting goals, and ensuring collaboration.
- Oversee project planning, execution, and delivery, ensuring alignment with business objectives.
- Manage all phases of technical projects, from conception to completion.
- Develop project specifications, track progress, and control costs.
- Foster a positive work environment, encouraging professional growth and knowledge sharing.
Qualifications
- Bachelor’s degree in computer science, Engineering, or a related field; Master’s degree preferred.
- 5+ years of hands-on experience in AI model development and deployment, with a focus on edge computing and local LLM inference.
- Strong programming skills in languages such as Python and C++.
- Proficiency in LLM frameworks (e.g., vLLM, Text generation inference, OpenLLM, Ray Serve and HuggingFace Transformers) and deep learning libraries.
- Extensive experience with GPU/TPU acceleration for AI inference, including optimization techniques (tensor, pipeline, data, sharded data parallelism) and performance tuning.
- Hands-on experience with one or more GPU frameworks: CUDA, Vulkan, OpenCL.
- Deep knowledge of GPU memory layout, familiarity with NVIDIA Jatison, ARM Mali or relevant SoC configurations.
- Knowledge of parallel computation, memory scheduling, and structural optimization.
- Excellent problem-solving and analytical skills, with a passion for innovation and continuous learning.
Additional Skills (Preferred)
- Experience with edge device hardware and software integration.
- Familiarity with edge computing architectures and IoT platforms.
- Experience with edge AI applications in domains such as robotics, autonomous vehicles, or industrial automation.
Similar Remote Jobs
More jobs at Extremenetworks
-
Sales / Business unspecified USAApr 19, 2025
-
Sales / Business unspecified GermanyApr 16, 2025
-
Marketing unspecified AmericasApr 04, 2025
More AI / ML jobs
-
Software Development inr 10,000/week IndiaApr 22, 2025
-
Software Development inr 10,000/week IndiaApr 22, 2025
-
Software Development base salary: $175,500.26, with bonuses USAApr 22, 2025
More jobs in Canada
-
Software Development competitive salary CanadaApr 22, 2025
-
Software Development $85,000 - $90,000/year cdn + vacation + benefits + sick days Europe, USA, CanadaApr 22, 2025
Kickstart Your Job Search
Need advice to apply?
Join our free
Webinar « 3
Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) »
Register for free
Unlock 53,853 additional remote jobs, advanced search & email notifications
Get Access Now
Too many emails? Declutter your inbox with Meco
Your home for reading newsletters
Try for free - no card required.
️
| 📍 | Be aware of the location restriction for this remote position: Canada |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
Back to Remote jobs >
Software Development
Software Development
|
Salary
💸
unspecified
|
Remote
Location
Canada
|
|
Job Type
full-time
|
Posted
Apr 09, 2025
|
️
| 📍 | Be aware of the location restriction for this remote position: Canada |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
