Simular logo
Simular
Posted 128 days agoVerified live 1d ago

Software Engineer, CUA Control

Brief overview

Palo AltoIn-person
UndergradOr in progress
2+ yrsMinimum
1 H-1B approvalsDept. of Labor
OS-level input automationAccessibility frameworks (AXUIElement, UI Automation, AT-SPI)UI element detectionScreen capture and coordinate mappingInput simulationReliability engineeringCross-platform developmentDOM and a11y tree navigationVisual groundingFeedback loop designResolution scaling and window occlusion managementCross-app focus management

About the company

Simular logo
Simularsimular.ai

The Autonomous Computer Company

Visa sponsorship history

2 years sponsoring, last filed FY2025

Data powered by U.S. Department of Labor. This does not guarantee sponsorship for this specific role.
1H-1B approved
50%approval rate
H-1B Petition ApprovalsVisas USCIS actually granted: the strongest sign the company sponsors.
20251

Job description

Summary

Simular is a company focused on AI-driven automation, and they are seeking a Software Engineer to work on the control layer of their systems. The role involves developing low-level computer control mechanisms and ensuring reliable interactions across various operating systems.

Responsibilities

  • Work on the low-level computer control stack: mouse/keyboard injection, screen capture, coordinate mapping, input simulation
  • Implement UI element detection using accessibility APIs (AXUIElement, UI Automation), DOM/a11y trees, and visual grounding
  • Help build the abstraction layer that lets our agent operate across OS platforms and application types
  • Tackle reliability problems: element targeting under UI changes, window occlusion, resolution scaling, cross-app focus management
  • Contribute to feedback loops: how does the agent know its action worked? How does it recover when something unexpected happens?
  • Work closely with the model and planning team on the interface between intent and execution

Skills

  • You've built OS-level input automation (CGEvent, SendInput, xdotool, or similar)
  • You understand accessibility frameworks - AXUIElement on macOS, UI Automation on Windows, AT-SPI on Linux
  • You've dealt with flaky element selectors, timing issues, resolution-dependent coordinates
  • You think carefully about reliability and edge cases
  • You've worked with tools like Playwright, Appium, PyAutoGUI, Hammerspoon, or similar
  • Experience with screen reader internals
  • Remote desktop protocols (RDP/VNC)
  • Game automation
  • LLM agent tool-use systems
  • Mobile device automation (iOS UIAutomation / XCTest, Android UIAutomator / Accessibility)

Qualifications

Must Haves

  • You've built OS-level input automation (CGEvent, SendInput, xdotool, or similar)
  • You understand accessibility frameworks - AXUIElement on macOS, UI Automation on Windows, AT-SPI on Linux
  • You've dealt with flaky element selectors, timing issues, resolution-dependent coordinates
  • You think carefully about reliability and edge cases
  • You've worked with tools like Playwright, Appium, PyAutoGUI, Hammerspoon, or similar

Nice to Haves

  • Experience with screen reader internals
  • remote desktop protocols (RDP/VNC)
  • game automation
  • LLM agent tool-use systems
  • mobile device automation (iOS UIAutomation / XCTest, Android UIAutomator / Accessibility)

More jobs like this

Software Engineer Jobs
Software Engineer, SimulationThis weekDice · RemoteModeling and Simulation EngineerSedaro · Arlington, VAForward Deployed EngineerSimular · RemoteSoftware Engineer InternSimular · Remote