AI inference is moving closer to the places where data is created. Cameras, factory equipment, vehicles, laptops, branch systems and other connected devices can now run increasingly capable models without sending every request to a public cloud service.