synxi means synchronize text with speech on video.. we've all seen bouncing balls and colorful karaoke.. synxi wants mix in new stuff:

1. easy to sync speech to text
2. emotive text in sync
3. on the fly

[edit] easy

easy synxi means automagic synchronization of text with speech on video.. automagic means software, where possible, automates the process.. this first step to synxi already exists in closed captioning tools:

• closed captioning
• speech to text
• SLS
• karaoke

questions:

• how does planetread do it?
• how do karaoke pros do it?
• how easy is it to do today?
• what are the tools?
  • YES
    • automatic sync
  • MAYBE
    • http://kaltura.com videos in wikis
    • Sophie (feasible)
    • sprout online flex (flash) editor
• are new tools making it easier?
  • free software?
• doth not speech-to-text suck? today yes, tomorrow less
  • gadgets listen, obey

[edit] emotive

emotive synxi means synch'd text that shows emotion.. so often *what* we say means less than *how* we say it.. if eyes can see in text any emotions that ears hear in voice, text may be easier to learn.. especially if eyes and ears engage heart in a meaningful context, such as a story.. tools already exist to detect emotion in speech:

• mit sociable machines

the tool now analyzes sound waves to parse emotional content in speech.. can this translate to animated emotive text in sync with sound?

[edit] live

live synxi means synchronize text with speech live, or on the fly.. imagine skyping someone and seeing what they say in text synxi.. wikipedia says for 5 years already the BBC does live subtitling (by having someone re-speak what is being broadcast).. is so, then next steps to synxi may be:

1. synchronize syllabic level text animation: $200 to learn more.. ugh
2. synxi animate speech to emotive text

crazy? processing power is soaring.. some parts of live synxi already work.. a few more cycles of moore's law and we can potentially skype synxi with any talking head live on the phone.. the first step to get there is to find/make very easy tools to sync text with youtube..

[edit] etc

animated text in sync with speech can try other tricks, maybe play with twext etc and whateva.. what matters now is knowledge of existing tools that may help us synxi text, so we learn more language.