Software Engineer, Kernel Development

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities.

As part of our Kernel Development and Optimization team you will develop and optimize a set of machine learning operations (e.g., matrix multiplication, convolutions) contributing to an open source project. This includes writing GPU-style kernels for a range of TensTorrent AI hardware, host side code and developing parallelisation strategies, with focus on performance. You will work closely with a team of highly skilled engineers to ensure our software runs at peak efficiency and delivers high-quality results to our clients and users.

This role is onsite, based out of Belgrade, Serbia.

Responsibilities

• Software Development: Participate in the design, development, and maintenance of specific Tenstorrent software components (connected to the hardware platform) for our applications. Develop and optimize kernels and kernel libraries for efficient machine learning and HPC applications.
• Special Program Optimization: Analyze and optimize low-level code to improve the performance and efficiency of our software, with a strong emphasis on tensor optimization.
• Machine Learning Integration: Collaborate with machine learning engineers and data scientists to integrate optimized kernels and low-level routines into machine learning frameworks and pipelines.
• Performance Profiling: Identify bottlenecks, conduct profiling, and develop strategies to address and resolve them.
• Testing and Debugging: Write comprehensive unit tests, conduct thorough debugging, and ensure the stability and reliability of kernel-level code.
• Documentation: Create clear and concise documentation for code, APIs, and best practices to facilitate collaboration within the team.
• Research and Innovation: Stay up-to-date with the latest developments in kernel development, tensor optimization, and machine learning to propose innovative solutions and improvements.

Experience & Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• Familiarity with machine learning frameworks and concepts.
• Familiarity with performance profiling and optimization tools.
• Beginner to mid-level proficiency in C/C++ or other relevant programming languages
• [Nice to have] Strong interest or experience in GPU kernel development, with a strong focus on low-level optimizations and tensor optimization.
• [Nice to have] Experience with GPU programming (CUDA, OpenCL) and knowledge of operating system internals.

Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.
This offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology. Due to U.S. export laws, including those codified in the U.S. Export Administration Regulations (EAR), the Company is required to ensure compliance with these laws when transferring technology to nationals of certain countries (such as EAR Country Groups D:1, E1, and E2). These requirements apply to persons located in the U.S. and all countries outside the U.S. As the position offered will have direct and/or indirect access to information, systems, or technologies subject to these laws, the offer may be contingent upon your citizenship/permanent residency status or ability to obtain prior license approval from the U.S. Commerce Department or applicable federal agency. If employment is not possible due to U.S. export laws, any offer of employment will be rescinded.