Using Webrtc and Webspeech API simultaneously - javascript

Currently I'm using Webrtc to stream both video and audio in Chrome. At the same time I'm using Chrome's Webspeech API to get the audio into text. This work's fine in desktop Chrome but when I try this on Android Chrome, the Webspeech API's onresult function doesn't fire if the Webrtc is streaming both video and audio.
Is there a way to have Webrtc streaming both audio and video and have Webspeech recognizing speech at the same time?
Thanks

Related

How to detect realtime webstreamed video frozen at webrtc using javascript?

when I was creating the videoCall App Using webrtc, the issue was when a remote streamed
video disconnects due to a network issue, the video was frozen,
How to detect real-time web-streamed video frozen at Webrtc?

Setting the audio Source in webrtc to speaker instead of mic

I am writing webrtc app and I want to set the audio source while sharing screen to be the speaker "the internal audio of the machine" instead of sharing the mic. I am using a firefox as a browser.

Voice recording on iPhone by using Safari and HTML5

I am developing a simple web application which only records a voice from microphone but I have some trouble.
HTML5 voice recording function works well on chrome and firefox desktop or android. But while using mobile browsers on iPhone even chrome and firefox it doesn't work.
I tried recorder.js and result did not change.
Is it possible to recording voice on safari or it is a missing function of safari or iOS?
May 2018 Update (because figuring this out has been tough with all the outdated info).
I found this demo that proves it is possible: https://kaliatech.github.io/web-audio-recording-tests/dist/#/test1
As far as I knew, even on the latest iOS (iOS 10), recording voice on iOS using HTML5 is still impossible. Since all the browsers on iOS are limited to use UIWebView which Safari on iOS uses as well, Chrome on iOS is not able to support any API that can be used for media recording.
For example, recorder.js which you used are built on Media Capture API. If you check caniuse.com, you will find this API is not supported on iOS. (Also check the issue here).
MediaRecorder API is also a promising API but still not supported by Apple's browser.
Check answers below for more information.
1. Record voice from IPhone using HTML5
2. Audio Recording html5 on iOS
It's now possible and "easy" to do on iOS11 for Safari! The mediaStream API is supported now. The mediaRecorder API however is not. This causes any existing examples out there to not work. So you'll have to implement your own mediaRecorder functionality by connecting the media stream to a webkitAudioContext ScriptProcessorNode and collect the stream buffer on the node's onaudioprocess event. You can then collect the iOS microphone's streaming audio data and do with it what you want, most likely merging it into a wav file for upload/download. This works for any browser that supports the Media Stream API.
Two gotcha's:
- iOS Safari likes to deallocate any AudioContext that wasn't created on the main thread (on a tap) so you can't initialize it on the device media access accepted callback.
- The scriptProccessorNode wont fire any audioprocessed events unless the input AND output are connected for some reason.
Since iOS11, Safari now supports Media Capture API:
New in Safari 11.0 – Camera and microphone access.
Added support for the Media Capture API.
Added ability for websites to access camera and microphone streams from a user's
device (user permission is required.)
Announcement by Apple - broken link as of Jul 2018
A copy of the announcement on someone's blog
Therefore recorder.js will work now.
I'm using the new iPhone 11 ProMax, with iOS13.3, and have been trying to build out a web app with voice recognition services via HTML5 to work in safari or any browser on my iPhone. It seems iOS developers have blocked audio / video recording at the os level. There is a limited workaround however that might be useful for someone coming here as I did.
https://blog.addpipe.com/safari-technology-preview-73-adds-limited-mediastream-recorder-api-support/
Basically, if you go into advanced settings for safari you can enable the mediaRecorder. Their demo works with video capture, I have not seen it with pure audio yet.
Safari on iOS 11 does NOT support the 2 standards which would make audio (only) recording possible (and easy to implement):
HTML Media Capture for audio (spec, correct syntax ) - audio recording should be passed to a native app which should pass the result back to the browser for upload (it works for video and picture)
MediaStream Recording API (spec, demo) - allows you to record to a blob directly in the browser. The recording can be downloaded or uploaded to a web server.

how to record the video through webcam using javascript

I want to record the videos through my webcam and want to upload them to the server. I don't want to use any plugin. How can I atleast just record the videos.
There's a project on GitHub called RecordRTC. It also provides a live demo here. This tool could run on browsers supporting WebRTC and getUserMedia. It could record both audio and video.
However, according to data from Can I Use, currently WebRTC and getUserMedia are only supported by Firefox, Chrome, and other blink engine browsers.
Use the navigator.getUserMedia function.
Check out these url`s.
Capturing Audio & Video
Have a look here
That being said, this question has been asked several times before:
How to record webcam and audio using webRTC and a server-based Peer connection
Access webcam without Flash
HTML 5 streaming webcam video?

Play MMS stream with clear HTML5/JS

Is it possible to play MMS audio stream with HTML5 / JavaScript in Google Chrome without any Windows Media Player object ?
I want to write a Google Chrome plugin that will allow playing that streams.
No. MMS is a proprietary Microsoft protocol.

Categories

Resources