KTIPF-ASD Funded Innovation

SpectraHomeHelper

Transforming Pediatric Autism Spectrum Disorders Healthcare with AI-powered Home Monitoring and Patient Navigation

以AI驅動的家庭監測和患者導引系統重塑兒童自閉症譜系障礙的醫療服務

SpectraHomeHelper AI Healthcare Vision Dashboard

SpectraHomeHelper is an integrated digital health solution combining AI home monitoring that prioritizes data privacy with a bilingual patient navigator driven by large language models. It provides continuous behavioral assessment and structured resource guidance for autistic children, shifting care from episodic visits to continuous support focused entirely on the family.

本項目致力於構建一個結合AI家庭行為監測與雙語大語言模型患者導引系統的創新數字醫療平台。它能夠為自閉症兒童提供連續的臨床級評估與結構化資源指導,以期待於實現高效、協調且以家庭為中心的普適化全面支持服務。

The "Triple Barrier" in ASD Care

Children with Autism Spectrum Disorder (ASD) in Hong Kong and mainland China encounter a persistent "triple barrier" when accessing care.
在香港和內地,自閉症兒童在獲取醫療服務時面臨嚴重的「三重障礙」。

The Triple Barrier Infographic
Diagnostic Bottlenecks Icon

Diagnostic Bottlenecks
診斷瓶頸

Specialist clinics face massive waitlists, leaving children waiting months or years for evaluation.
專科門診面臨巨大診斷瓶頸,導致候診名單極長,患兒往往需等待數月至數年才能確診。

Inequitable Access
資源分布不均

Disproportionately impacts low-income and non-urban families, who struggle to afford frequent clinic visits and transport.
醫療資源獲取存在顯著不平等,低收入和非城市家庭難以承擔頻繁就診的交通與時間成本。

Fragmented Coordination Icon

Fragmented Coordination
護理碎片化

Families independently navigate complex guidelines, subsidies, and disjointed care settings, missing day-to-day variability.
照顧者必須獨自摸索複雜的醫療指南和補貼,且短暫的門診難以捕捉兒童日常行為的真實變化。

This leads to delayed diagnoses, inconsistent follow-ups, elevated caregiver stress, and widening disparities in developmental outcomes.
這種現狀不僅導致了診斷和治療的延誤,給家庭帶來了極大的精神和經濟壓力,也進一步拉大了自閉症兒童在早期發育結果上的巨大差距。


The Solution

We propose a comprehensive solution combining AI-powered home monitoring with an LLM-based patient navigator.
我們提出了一套結合AI家庭監測與大語言模型患者導引系統的綜合解決方案。

AI Home Monitor
家庭監測器

Uses a smartphone and depth camera to record structured parent-child block-play sessions at home.
利用智能手機和深度攝像頭在家中記錄結構化的親子積木遊戲。

  • Privacy algorithms (端側算法): Extracts behavioral features safely while protecting family data.
    通過保護隱私的端側算法安全提取行為特徵。
  • Multimodal Foundation Model (MFM): Generates continuous clinical dashboards directly for clinicians.
    利用多模態基礎模型生成連續的臨床評估儀表板供醫生參考。
  • Clinical Grade (臨床級): Brings assessment into the home setting.
    將臨床評估直接融入日常家庭場景。
AI Home Monitoring Setup

LLM Patient Navigator
患者導引系統

A bilingual AI assistant driven by retrieval-augmented generation (RAG) providing constant family support.
這是一個由檢索增強生成驅動的雙語助手,能為家庭提供全天候指導。

  • Resource Integration (資源整合): Integrates verified clinic directories, school services, and financial subsidies.
    整合經過驗證的診所目錄、教育服務和經濟補貼資源。
  • Bilingual Accessible Support (雙語降維解答): Answers caregiver questions in accessible language.
    用通俗語言和多種語言解答家庭的疑問。
  • Continuous Coordinated Care: Eliminates administrative fragmentation.
    消除了醫療信息碎片化,保障協調支持。
LLM Patient Navigator

Beneficiaries & Impact

Transforming pediatric ASD care into a coordinated, long-term support network.
推動自閉症護理走向連續的長期支持模式。

100

Children & Families
主要受益人 (Primary Beneficiary)

30

Clinicians
次要受益人 (Secondary Beneficiary)

5

Policymakers & Schools
其他受益人 (Other Beneficiaries)

SpectraHomeHelper significantly shortens time-to-evaluation and reduces administrative burdens for caregivers, particularly benefiting low-income or non-urban families. By delivering continuous behavioral insights, it enhances diagnostic confidence and efficiency for clinicians. Furthermore, the system provides health authorities with essential data to identify service gaps, facilitating equitable healthcare policies.

本項目大幅縮短了患兒評估等待時間,減輕了家長的行政與經濟負擔,尤其惠及低收入家庭。連續的家庭行為監測數據顯著提升了臨床醫生的診斷信心和效率。同時,系統為公共衛生部門提供了真實世界數據支持,有助於優化資源配置和制定公平的醫療政策。

Collaborators

HATCH Foundation (Hong Kong), Shandong University Qilu Hospital Cohort, ASD NGOs, and School services.
香港達仁祥慕基金會兒童醫學創科中心(HATCH Foundation)、山東大學齊魯醫院、自閉症相關非政府機構(NGOs)及學校服務機構。