Realtime speech to text along with video frame tagging

This is part of a larger program and is the first step. The developer selected for this project is most likely going to be retained for the subsequent segments of the program - however we may choose to switch at our discretion.

We have a web application based on PHP (mysqli extensions) / MySQL / HTML5 / CSS3 / JQuery / JavaScript / AJAX. This application involves recorded and real time videos being played back (HTML5 video) through the web application. This information is being proved as a background of the technology stack involved in our web application. The developer does not have to do any development on this web application. We will take care of any integrations of the code from this project to the web application.


As a video is playing inside an HTML5 <video></video> segment, we need to record any words (English for now) being spoken (microphone input only) on a computer or mobile device, in an audio file (MP3) along with the words being converted to text and made visible in a "textarea" field for subsequent update on a MySQL database. It is very important to track the timestamp of the entire session (every second), so that we keep the video synchronized with the audio stream being recorded and the corresponding text transcription being made. The timestamp will be in seconds for the length of the video. While the "textarea" mentioned above simply displays the speech to text content, in the background however every second for the duration of the video (starting with 0 seconds), the system needs to store either nothing or the text version of the word being spoken. For example if the word "tester" is spoken and translated to text at the 223rd second into the video, then in a two dimensional array the word "tester" would be updated on the 223 second record in the array. Upon "submit" that contents of the array would be updated in a table in the MySQL database.

Any open source speech to text APIs (such as Google) that allows speech to text translation for multiple languages, based on developer's recommendation, may be used in this process

For your information, this timestamp tracking will be required in a future milestone of the larger program, but the groundwork for that future application must be ready now. For example, if I am searching the text transcription for the word "tester" and it was 3 minutes 43 seconds into the video, then in a future application (not in the scope of this project) the user playing the video will automatically be fast forwarded to that video frame starting at 3 minutes 43 seconds and can start playing. That is the ultimate objective in a future project within the program.

Evner: AJAX, Javascript, jQuery / Prototype, MySQL, PHP

Se mere: convert video speech text, speech text video, video frame extract, google cloud video intelligence api, google vision api, amazon rekognition, google speech api documentation, video analysis api, google video intelligence api demo, video recognition api, google cloud text to speech, php, mysql, ajax, javascript, jquery / prototype, dynamic flash text video, free sapi speech text, net grabber video frame class, speech text symbian

Om arbejdsgiveren:
( 2 bedømmelser ) Oceanside, United States

Projekt ID: #17094444

5 freelancere byder i gennemsnit $157 på dette job


Hi there I have read your job description with care and I am interested in your project The skills you require are my core skills Also, I think that I can do the video problem on web site because I have a lot of we Flere

$155 USD in 3 dage
(6 bedømmelser)

Dear,sir! If you assign me this project,I will do my best. I hope you will discuss me about your project. Through this chance you might know my skills better. I will be responsible about my project to the end Flere

$100 USD in 3 dage
(6 bedømmelser)

Hi, As I have seen your job post I am ready to work for you . I am having extensive experience in PHP website development. * PSD to HTML * Extension Installation. * Product and content uploading. * Site Opt Flere

$155 USD in 3 dage
(1 bedømmelse)

Hi , I am pradip kumar singh , I did one project as same as your requirement , I have 3 years experience in IT field with development site

$155 USD in 3 dage
(0 bedømmelser)

Hi, Trust you are doing good. We have dedicated team on PHP and we can start working on your project right away, let’s discuss your requirement in more detail Our Expertise A thorough understanding of develop Flere

$222 USD in 3 dage
(0 bedømmelser)