Vidlora guide

How video transcription works

Automatic transcription listens to the audio track of a video and writes down what is said, with timestamps. Behind the scenes it involves extracting audio, splitting it into segments, running a speech-recognition model and organising the output into readable text. Accuracy depends heavily on the recording. This guide explains each stage, what affects the result, how to prepare audio for better transcripts, and how to review and use the output responsibly.

7 minute read

From video file to audio

Speech recognition works on audio, so the first step is separating the audio stream from the video. The picture is discarded and the sound is decoded and, if needed, resampled to the rate the model expects, commonly 16 kHz mono. Speech does not need the high-frequency range music does, so this reduces data without harming recognition. For a one-hour video, that audio is about 1.9 MB per minute uncompressed at 16-bit mono, which is far lighter than the video. This is also why transcribing from a small, low-resolution copy of a video works just as well as from the original: only the audio quality matters, not the resolution of the picture.

How a speech-recognition model works

Modern systems use neural networks trained on hundreds of thousands of hours of speech paired with text. The audio is converted into a spectrogram, a picture of frequencies over time, and the model predicts a sequence of words from it. It does not just match sounds; it uses context to choose between words that sound alike, such as their and there, which is why it can handle grammar and common phrases. Larger models are generally more accurate but slower. Many handle dozens of languages and can detect which language is being spoken. They are probabilistic, so they may produce confident-looking but wrong text, especially with names, jargon and unclear audio.

Segments and timestamps

Long audio is processed in short windows, often around 30 seconds, because models work best on limited context. The model returns text for each segment together with the start and end time of each phrase. These timestamps allow you to click a line in the transcript and jump to the moment in the video, to build subtitles, or to find where a topic was discussed. Timestamps are usually accurate to within a fraction of a second, but can drift slightly at segment boundaries or after long silences. Word-level timing is more precise than phrase-level timing, and subtitle formats such as SRT and VTT simply store start time, end time and text for each phrase.

From fragments to readable paragraphs

Raw output is a list of short phrases, often a single sentence or half-sentence each, which is difficult to read. A good tool groups segments into paragraphs based on pauses, sentence boundaries and length, so a ten-minute talk becomes a few dozen paragraphs rather than hundreds of lines. Punctuation and capitalisation come from the model itself, which predicts them along with words. Speaker labels, which identify who is talking, require a separate step called diarisation and are not always included. Without it, a conversation looks like one continuous block, so you may need to mark speaker changes by hand when you need a proper interview transcript.

What affects accuracy

On clean, single-speaker recordings with a good microphone, modern models can reach 95 percent or better word accuracy in major languages, meaning about one error in every twenty words or fewer. Accuracy drops with background noise, music beds, echoey rooms, overlapping speakers, heavy accents, fast speech, technical vocabulary and low-bitrate audio. Phone recordings of meetings in a large room often fall well below that. Languages with less training data perform worse. Names of people, products and places are the most common errors. Numbers and homophones also cause trouble. Accuracy is not uniform across a file: it can be excellent for ten minutes and then poor when a noisy section begins.

Preparing your audio

You can improve results before transcribing. Record close to the microphone, in a quiet room, with one person talking at a time. Avoid background music while speaking. If you must work with an existing file, trim long stretches of silence or irrelevant material so the model focuses on speech. Use the highest-quality source available instead of a re-compressed copy, since 64 kbps audio hides consonants. Normalising a very quiet recording can help. Choose the correct language if the tool asks, because automatic detection can fail on short clips or code-switching. For long files, splitting by topic makes review easier. None of these steps takes long, and together they often improve accuracy more than choosing a different model.

Reviewing and editing the transcript

Treat automatic transcripts as drafts. Read through while listening to the key sections, correct names, numbers and technical terms, and fix punctuation where meaning changes. Search for words you know are tricky and check each occurrence. If you plan to publish subtitles, check line length, reading speed, and timing; around 15 to 17 characters per second is a comfortable maximum. Remove filler words only if you want a clean-read version, and keep a verbatim copy when accuracy matters, for example for legal or research use. Add speaker names where relevant. A quick review of a one-hour recording typically takes 20 to 40 minutes, far less than typing from scratch, which can take four hours or more.

Privacy and responsible use

A transcript can be more sensitive than the video, since text is searchable and easy to copy. Before uploading a recording to any online service, consider whether it includes personal, medical, legal or confidential information, and whether the people speaking agreed to be recorded and transcribed. Many places require consent to record conversations. Check how the service handles files: Vidlora processes uploads and removes them afterwards, but for highly confidential material, an offline tool may be more appropriate. Do not present machine-generated text as a verbatim quotation without checking it. When you publish a transcript of someone else's content, make sure you have permission, credit the source, and note that the text was generated automatically and may contain errors.

Try the free video downloader

Get formats

Related guides