What is the streaming protocol used in Weylus?

[KarimElsayad247]

Does it stream over HTTP or RTSP? is it a standard protocol or a custom made one? I'm currently looking for a library to stream Weylus on android

https://developer.android.com/media/platform/supported-formats#network

[KarimElsayad247]

BTW it felt like this is the function that throws the video packet over the wire, but not really sure

// this is used as callback in lib/encode_video.c via ffmpegs AVIOContext
#[no_mangle]
fn write_video_packet(video_encoder: *mut c_void, buf: *const c_uchar, buf_size: c_int) -> c_int {
    let video_encoder = unsafe { (video_encoder as *mut VideoEncoder).as_mut().unwrap() };
    (video_encoder.write_data)(unsafe {
        std::slice::from_raw_parts(buf as *const u8, buf_size as usize)
    });
    0
}

[H-M-H]

Weylus sends fragmented mp4 frames with one video stream encoded using the H.264 codec as binary messages over the websocket connection. See

Weylus/ts/lib.ts

Lines 946 to 960 in d30b8b3

	if (msg == "NewVideo") {
	let MS = window.ManagedMediaSource ? window.ManagedMediaSource : window.MediaSource;
	mediaSource = new MS();
	sourceBuffer = null;
	video.src = URL.createObjectURL(mediaSource);
	mediaSource.addEventListener("sourceopen", (_) => {
	let mimeType = 'video/mp4; codecs="avc1.4D403D"';
	if (!MS.isTypeSupported(mimeType))
	mimeType = "video/mp4";
	sourceBuffer = mediaSource.addSourceBuffer(mimeType);
	sourceBuffer.addEventListener("updateend", upd_buf);
	// try to recover from errors by restarting the video
	if (sourceBuffer.onerror)
	sourceBuffer.onerror = () => settings.send_server_config();
	})

and

Weylus/ts/lib.ts

Lines 917 to 941 in d30b8b3

	function upd_buf() {
	if (sourceBuffer == null)
	return;
	if (!sourceBuffer.updating && queue.length > 0 && mediaSource.readyState == "open") {
	let buffer_length = 0;
	if (sourceBuffer.buffered.length) {
	// Assume only one time range...
	buffer_length = sourceBuffer.buffered.end(0) - sourceBuffer.buffered.start(0);
	}
	if (buffer_length > MAX_BUFFER_LENGTH) {
	sourceBuffer.remove(0, sourceBuffer.buffered.end(0) - MAX_BUFFER_LENGTH / 2);
	// This will trigger updateend when finished
	} else {
	try {
	sourceBuffer.appendBuffer(queue.shift());
	} catch (err) {
	log(LogLevel.DEBUG, "Error appending to sourceBuffer:" + err);
	// Drop everything, and try to pick up the stream again
	if (sourceBuffer.updating)
	sourceBuffer.abort();
	sourceBuffer.remove(0, Infinity);
	}
	}
	}
	}

for how it is handled in a browser based client.