NeuronFRAMES is an AI-assisted rehabilitation platform that combines computer vision, sensor-based input, and gamified therapy to make recovery more accessible, engaging, and measurable.

Tracks body landmarks through a standard webcam, enabling movement analysis without specialized equipment.
Interactive browser-based games transform repetitive exercises into engaging activities that increase patient motivation and adherence.
Arduino-powered sensors such as force-sensitive resistors connect physical rehabilitation tools to the digital therapy platform.
NeuronFRAMES is a research and innovation project developing a web-based AI-assisted rehabilitation system. It combines computer vision pose detection, sensor-based input devices, gamified therapy exercises, speech therapy tools, and progress tracking into a single accessible platform.
Globally, millions of patients cannot access consistent rehabilitation therapy due to cost, geographic distance, or limited clinical resources. NeuronFRAMES aims to address these challenges by delivering therapy tools through a standard web browser, requiring only a webcam and internet connection.
Built with HTML, CSS, JavaScript, and Arduino sensors, the platform is designed to be affordable and deployable in diverse settings โ from clinical facilities to patients' homes.
Runs in any modern browser โ no software installation or expensive hardware required.
Data-driven session records help clinicians and patients monitor improvement over time.
Game mechanics keep patients engaged and encourage consistent practice between sessions.
Open web technologies and affordable sensors make the system accessible in resource-limited settings.
NeuronFRAMES addresses systemic barriers in rehabilitation access โ improving quality of life for patients, reducing burden on healthcare professionals, and bringing therapy to communities that need it most.
Patients recovering from injury, stroke, or neurological disorders regain independence faster through consistent, guided rehabilitation. Accessible therapy tools help restore mobility, speech, and confidence during recovery.
Doctors and therapists spend less time on repetitive monitoring tasks and manual documentation. Automated data collection and progress tracking free clinicians to focus on diagnosis, treatment planning, and patient interaction.
Millions of patients in remote or resource-limited areas lack access to rehabilitation facilities. NeuronFRAMES delivers therapy through a web browser โ bringing rehabilitation to communities where clinics and specialists are unavailable.
Patients can perform prescribed exercises at home instead of traveling to hospitals for every session. Home-based rehabilitation reduces the physical, financial, and time burden on patients and their families.
Gamified therapy exercises and family-supported training create an engaging rehabilitation experience that increases adherence. When therapy feels rewarding and family members participate, patients are far more likely to maintain consistent practice and achieve better long-term outcomes.
Early pilot data from community deployments and hospital trials demonstrate measurable rehabilitation outcomes using NeuronFRAMES.
3-month community deployment (MayโJuly 2025) of home-based rehabilitation using NeuronFRAMES.
Supervised pilot at Burapha University Hospital. Early results support further clinical investigation.
Home-based therapy reduces hospital visits, transportation expenses, and per-session fees โ making sustained rehabilitation financially viable.
NeuronFRAMES delivers therapy through a standard web browser โ no specialized equipment required. Field trials show measurable outcomes in resource-limited settings.
These results are drawn from early-stage pilot trials and field deployments. While promising, they represent initial findings that require validation through larger controlled studies. NeuronFRAMES is committed to rigorous, evidence-based development โ expanding trials with clinical partners to build the evidence needed for wider adoption.
Each mode addresses a specific rehabilitation need, from physical movement to speech recovery, using accessible web-based technology.
A pose-detection rehabilitation mode that tracks patient movement using camera-based body landmark detection. It provides visual guidance through pose overlays and automatically counts repetitions and evaluates movement accuracy โ giving patients real-time feedback during exercise sessions.
A game-based therapy mode where patients perform rehabilitation movements through interactive browser games โ including reaction tasks, card matching, and motion-based challenges. Designed to increase motivation and adherence by making repetitive exercises feel engaging and rewarding.
A sensor-integrated rehabilitation system that connects hardware devices โ such as grip sensors using force-sensitive resistors and Arduino microcontrollers โ to interactive therapy games. Patients interact with therapy exercises using physical input devices, bridging the gap between tangible rehabilitation tools and digital feedback.
A speech rehabilitation module that uses browser-based speech recognition to support pronunciation practice, vocabulary exercises, and communication training. Patients receive immediate feedback on their speech accuracy through the Web Speech API, making speech therapy more accessible outside clinical settings.
NeuronFRAMES automatically adjusts therapy difficulty based on patient performance โ ensuring exercises remain challenging but achievable throughout the recovery process.
When the system detects a patient is struggling, it responds by easing demands. When performance improves, therapy challenges increase gradually to promote continued progress.
Patient motivation significantly increases when family members participate in the rehabilitation process. NeuronFRAMES is designed to include family involvement as a core component of home-based therapy.
This feature is particularly important in home rehabilitation environments, where consistent practice depends on a support system that extends beyond the clinical setting.
Prescribes & monitors
Performs exercises
Assists & encourages
NeuronFRAMES integrates into hospital and clinic workflows โ automating documentation, enabling remote monitoring, and providing quantitative outcome data. Pilot results from Burapha University Hospital demonstrate measurable clinical improvements across supervised patient cohorts.
Every therapy session generates structured data โ movement accuracy, repetition counts, grip force, and game performance scores. In the hospital pilot, clinicians used this data to track patient progress across 6โ9 weeks, observing ~24% overall improvement without additional manual documentation.
Home-based therapy sessions reduce hospital visits, transportation expenses, and per-session fees. Pilot data indicate average savings of $264/month per patient (up to $320/month), representing an approximate 47% reduction in out-of-pocket costs โ making sustained rehabilitation financially viable for more patients.
The system produces structured session summaries and progress reports that clinicians can use for treatment planning, clinical documentation, and interdisciplinary communication โ reducing time spent on manual record-keeping.
Clinicians review patient therapy data remotely, tracking exercise completion and movement quality between visits. In the community trial, 96 participants across 61 households completed home-based therapy over 3 months โ demonstrating that remote rehabilitation can produce measurable outcomes (23% avg improvement) outside clinical settings.
NeuronFRAMES is developed through academic research, innovation competitions, and collaboration with rehabilitation professionals who inform every design decision.
The project is grounded in research on computer vision for movement analysis, gamification in healthcare, and accessible rehabilitation technology. Each module is informed by existing evidence on effective therapy delivery.
Physiotherapists, occupational therapists, and speech-language professionals provide ongoing guidance to ensure the system's exercises, metrics, and interfaces align with real clinical workflows and patient needs.
NeuronFRAMES has been developed through iterative prototyping cycles, incorporating user testing, hardware integration experiments, and software architecture improvements at each stage.
Chacharin Lertyosbordin, Maythus Tangprapa, Nuntipat Jiwasurat โ Presented at ACM/IEEE HRI 2025 and awarded People's Choice Award.
Chacharin Lertyosbordin, Maythus Tangprapa, Nuntipat Jiwasurat โ IEEE Xplore listing of the HRI 2025 conference paper.
Nuntipat Jiwasurat, Maythus Tangprapa, Filippo Sanfilippo โ Presents a gamified rehabilitation system combining mirror therapy with FSR-based input for stroke recovery.
Clinical feedback from rehabilitation professionals at leading institutions helps guide system development โ ensuring NeuronFRAMES meets real-world clinical needs.
Collaborative partnership across three clinical divisions โ providing guidance on rehabilitation protocols, patient assessment, therapy design, and technology integration into clinical workflows.
Guiding the design of activities targeting hand coordination, daily living skills, and cognitive exercises for patients recovering from stroke and neurological conditions.
Providing feedback on how NeuronFRAMES integrates into structured therapy schedules, bedside exercise routines, and patient progress monitoring during hospital stays.
Informing how NeuronFRAMES supports continuity of care โ enabling patients to continue prescribed exercises at home while clinicians track adherence between visits.
Contributing clinical feedback on therapy exercise design, patient engagement strategies, and system usability for rehabilitation professionals.
Collaborating on neurological and orthopedic rehabilitation approaches, integrating clinical expertise in brain and musculoskeletal recovery with technology-assisted therapy.
Research collaboration on AI-driven rehabilitation systems, biomechatronic sensor integration, and collaborative robotics for accessible therapy solutions.
Academic partnership supporting engineering research, system architecture development, and technical innovation in rehabilitation technology.
A rehabilitation platform built for clinical deployment โ delivering measurable patient outcomes with minimal infrastructure requirements.
Runs entirely in a standard web browser. No specialized software installation, no expensive proprietary hardware, and no complex IT infrastructure. A webcam, internet connection, and browser are all that is needed to begin delivering therapy.
Gamified therapy exercises produce measurably higher adherence rates compared with traditional repetitive rehabilitation. Patients are more likely to complete their prescribed programs when therapy feels engaging rather than monotonous.
Supports both in-clinic supervised sessions and remote home-based rehabilitation. A single platform serves patients across multiple care settings โ reducing the gap between hospital visits and enabling continuous therapy.
Every therapy session generates quantitative metrics โ repetition counts, movement accuracy, reaction times, grip strength, and speech response data. Clinicians receive objective evidence to support treatment planning and outcome reporting.
Whether you are a rehabilitation professional, researcher, educator, or student interested in accessible therapy technology โ we welcome your questions, feedback, and collaboration ideas.