A common architecture of real-time sign language analysis system was discussed in the article. The main requirements to the system, main principles of modules and their structure were described. Integration of modules in main system utilizing high-speed TCP/IP network was proposed.