Frame rate#Frame rates in video games

{{Further|Motion perception}}

The temporal sensitivity and resolution of human vision varies depending on the type and characteristics of visual stimulus, and it differs between individuals. The human visual system can process 10 to 12 images per second and perceive them individually, while higher rates are perceived as motion.{{cite book |url=https://books.google.com/books?id=jzbUUL0xJAEC&pg=PA24 |pages=24–26 |last1=Read |first1=Paul |last2=Meyer |first2=Mark-Paul |author3=Gamma Group |title=Restoration of motion picture film |publisher=Butterworth-Heinemann |year=2000 |isbn=978-0-7506-2793-1 |series=Conservation and Museology}} Modulated light (such as a computer display) is perceived as stable by the majority of participants in studies when the rate is higher than 50 Hz. This perception of modulated light as steady is known as the flicker fusion threshold. However, when the modulated light is non-uniform and contains an image, the flicker fusion threshold can be much higher, in the hundreds of hertz.{{citation |pmc=4314649 |title=Humans perceive flicker artefacts at 500 Hz |author=James Davis |year=1986 |pmid=25644611 |doi=10.1038/srep07861 |volume=5 |journal=Sci. Rep. |pages=7861}} With regard to image recognition, people have been found to recognize a specific image in an unbroken series of different images, each of which lasts as little as 13 milliseconds.{{cite journal |title=Detecting meaning in RSVP at 13 ms per picture |date=December 28, 2013 |doi=10.3758/s13414-013-0605-z |pmid=24374558 |volume=76 |issue=2 |journal=Attention, Perception, & Psychophysics |pages=270–279 |last1=Potter |first1=Mary C. |url=https://dspace.mit.edu/bitstream/1721.1/107157/1/13414_2013_605_ReferencePDF.pdf |archive-url=https://ghostarchive.org/archive/20221009/https://dspace.mit.edu/bitstream/1721.1/107157/1/13414_2013_605_ReferencePDF.pdf |archive-date=2022-10-09 |url-status=live |hdl=1721.1/107157|s2cid=180862 |hdl-access=free }} Persistence of vision sometimes accounts for very short single-millisecond visual stimulus having a perceived duration of between 100 ms and 400 ms. Multiple stimuli that are very short are sometimes perceived as a single stimulus, such as a 10 ms green flash of light immediately followed by a 10 ms red flash of light perceived as a single yellow flash of light.{{cite journal |title=Conservation of temporal information by perceptual systems |author=Robert Efron |journal=Perception & Psychophysics |volume=14 |issue=3 |pages=518–530 |doi=10.3758/bf03211193 |year=1973 |doi-access=free}}

Early silent films had stated frame rates anywhere from 16 to 24 frames per second (FPS),{{cite book |chapter-url=https://books.google.com/books?id=sWdBAQAAQBAJ&pg=PA588 |title=The Oxford Handbook of Film Music Studies |chapter=Audio-visual Palimpsests: Resynchronizing Silent Films with 'Special' Music |last=Brown |first=Julie |editor=David Neumeyer |page=588 |publisher=Oxford University Press |year=2014 |isbn=978-0195328493}} but since the cameras were hand-cranked, the rate often changed during the scene to fit the mood. Projectionists could also change the frame rate in the theater by adjusting a rheostat controlling the voltage powering the film-carrying mechanism in the projector.{{cite book |title=Silent Clowns |url=https://archive.org/details/silentclowns00kerrrich |url-access=limited |last=Kerr |first=Walter |publisher=Knopf |year=1975 |page=[https://archive.org/details/silentclowns00kerrrich/page/36 36] |isbn=978-0394469072}} Film companies often intended for theaters to show their silent films at a higher frame rate than that at which they were filmed.{{cite book |title=Seductive cinema: the art of silent film |last=Card |first=James |publisher=Knopf |year=1994 |page=[https://archive.org/details/seductivecinemaa00card/page/53 53] |isbn=978-0394572185 |url-access=registration |url=https://archive.org/details/seductivecinemaa00card/page/53 }} These frame rates were enough for the sense of motion, but it was perceived as jerky motion. To minimize the perceived flicker, projectors employed dual- and triple-blade shutters, so each frame was displayed two or three times, increasing the flicker rate to 48 or 72 hertz and reducing eye strain. Thomas Edison said that 46 frames per second was the minimum needed for the eye to perceive motion: "Anything less will strain the eye."{{cite journal |last=Brownlow |first=Kevin |date=Summer 1980 |title=Silent Films: What Was the Right Speed? |journal=Sight & Sound |volume=49 |issue=3 |pages=164–167 |url=http://www.cinemaweb.com/silentfilm/bookshelf/18_kb_2.htm |archive-url=https://web.archive.org/web/20110708155615/http://www.cinemaweb.com/silentfilm/bookshelf/18_kb_2.htm |archive-date=8 July 2011 |access-date=2 May 2012}}{{cite book |last1=Elsaesser |first1=Thomas |last2=Barker |first2=Adam |title=Early cinema: space, frame, narrative |year=1990 |publisher=BFI Publishing |isbn=978-0-85170-244-5 |page=284}} In the mid to late 1920s, the frame rate for silent film increased to 20–26 FPS.

When sound film was introduced in 1926, variations in film speed were no longer tolerated, as the human ear is more sensitive than the eye to changes in frequency. Many theaters had shown silent films at 22 to 26 FPS, which is why the industry chose 24 FPS for sound film as a compromise.{{Citation |last=TWiT Netcast Network |title=How 24 FPS Became Standard |date=2017-03-30 |url=https://www.youtube.com/watch?v=UcjYqfMaeHU | archive-url=https://ghostarchive.org/varchive/youtube/20211104/UcjYqfMaeHU| archive-date=2021-11-04 | url-status=live|access-date=2017-03-31}}{{cbignore}} From 1927 to 1930, as various studios updated equipment, the rate of 24 FPS became standard for 35 mm sound film. At 24 FPS, the film travels through the projector at a rate of {{convert|456|mm|in}} per second. This allowed simple two-blade shutters to give a projected series of images at 48 per second, satisfying Edison's recommendation. Many modern 35 mm film projectors use three-blade shutters to give 72 images per second—each frame is flashed on screen three times.

Image:Animhorse.gif of a galloping horse is displayed at 12 drawings per second, and the fast motion is on the edge of being objectionably jerky.]]

In drawn animation, moving characters are often shot "on twos", that is to say, one drawing is shown for every two frames of film (which usually runs at 24 frame per second), meaning there are only 12 drawings per second.{{cite web |last1=Chew |first1=Johnny |title=What Are Ones, Twos, and Threes in Animation? |url=https://www.lifewire.com/what-are-ones-twos-and-threes-4057778 |publisher=Lifewire |access-date=August 8, 2018}} Even though the image update rate is low, the fluidity is satisfactory for most subjects. However, when a character is required to perform a quick movement, it is usually necessary to revert to animating "on ones", as "twos" are too slow to convey the motion adequately. A blend of the two techniques keeps the eye fooled without unnecessary production cost.{{cite book |last1=Whitaker |first1=Harold |last2=Sito |first2=John Halas; updated by Tim |title=Timing for animation |date=2009 |publisher=Elsevier/Focal Press |location=Amsterdam |isbn=978-0240521602 |page=52 |edition=2nd |url=https://books.google.com/books?id=yMgqBgAAQBAJ&pg=PA52 |access-date=August 8, 2018}}

Animation for most "Saturday morning cartoons" was produced as cheaply as possible and was most often shot on "threes" or even "fours", i.e. three or four frames per drawing. This translates to only 8 or 6 drawings per second respectively. Anime is also usually drawn on threes or twos.{{cite web |url=https://www.animenewsnetwork.com/encyclopedia/lexicon.php?id=61 |title=Shot on threes (ones, twos, etc.) |website=Anime News Network}}{{cite web |title=CLIP STUDIO PAINT アニメーション機能の使い方 |url=https://www.youtube.com/watch?v=qQalCLD6ky0&t=833 | archive-url=https://ghostarchive.org/varchive/youtube/20211104/qQalCLD6ky0| archive-date=2021-11-04 | url-status=live|last=CLIP STUDIO |date=12 February 2016 |via=YouTube }}{{cbignore}}

{{See also|List of broadcast video formats}}

Due to the mains frequency of electric grids, analog television broadcast was developed with frame rates of 50 Hz (most of the world) or 60 Hz (Canada, US, Mexico, Philippines, Japan, South Korea). The frequency of the electricity grid was extremely stable and therefore it was logical to use for synchronization.

The introduction of color television technology made it necessary to lower that 60 FPS frequency by 0.1% to avoid "dot crawl", a display artifact appearing on legacy black-and-white displays, showing up on highly-color-saturated surfaces. It was found that by lowering the frame rate by 0.1%, the undesirable effect was minimized.

{{As of|2021}}, video transmission standards in North America, Japan, and South Korea are still based on 60/1.001 ≈ 59.94 images per second. Two sizes of images are typically used: 1920×1080 ("1080i/p") and 1280×720 ("720p"). Confusingly, interlaced formats are customarily stated at 1/2 their image rate, 29.97/25 FPS, and double their image height, but these statements are purely custom; in each format, 60 images per second are produced. A resolution of 1080i produces 59.94 or 50 1920×540 images, each squashed to half-height in the photographic process and stretched back to fill the screen on playback in a television set. The 720p format produces 59.94/50 or 29.97/25 1280×720p images, not squeezed, so that no expansion or squeezing of the image is necessary. This confusion was industry-wide in the early days of digital video software, with much software being written incorrectly, the developers believing that only 29.97 images were expected each second, which was incorrect. While it was true that each picture element was polled and sent only 29.97 times per second, the pixel location immediately below that one was polled 1/60 of a second later, part of a completely separate image for the next 1/60-second frame.

At its native 24 FPS rate, film could not be displayed on 60 Hz video without the necessary pulldown process, often leading to "judder": to convert 24 frames per second into 60 frames per second, every odd frame is repeated, playing twice, while every even frame is tripled. This creates uneven motion, appearing stroboscopic. Other conversions have similar uneven frame doubling. Newer video standards support 120, 240, or 300 frames per second, so frames can be evenly sampled for standard frame rates such as 24, 48 and 60 FPS film or 25, 30, 50 or 60 FPS video. Of course these higher frame rates may also be displayed at their native rates.[http://downloads.bbc.co.uk/rd/pubs/whp/whp-pdf-files/WHP169.pdf High Frame-Rate Television], BBC White Paper WHP 169, September 2008, M. Armstrong, D. Flynn, M. Hammond, PAWAN Jahajpuria S. Jolly, R. Salmon.{{citation |url=https://www.engadget.com/2014/11/27/avatar-sequels-to-shoot-at-48fps/ |title=James Cameron's 'Avatar' sequels will stick to 48 frames per second |author=Jon Fingas |date=November 27, 2014 |work=Engadget |access-date=April 15, 2017}}

In electronic camera specifications frame rate refers to the maximum possible rate frames that can be captured (e.g. if the exposure time were set to near-zero), but in practice, other settings (such as exposure time) may reduce the actual frequency to a lower number than the frame rate.{{cite web|last = Whaley|first = Sean|date = 21 November 2018|title = What is Frame Rate and Why is it Important to PC Gaming?|url = https://www.hp.com/us-en/shop/tech-takes/what-is-frame-rate|access-date = 5 August 2021}}

In computer video games, frame rate plays an important part in the experience as, unlike film, games are rendered in real-time. 60 frames per second has for a long time been considered the minimum frame rate for smoothly animated game play.{{Cite news |author1=Andy Edser |date=2024-03-26 |title=I used to be a frame rate snob but owning a Steam Deck has made me realise the error of my ways |url=https://www.pcgamer.com/hardware/handheld-gaming-pcs/i-used-to-be-a-frame-rate-snob-but-owning-a-steam-deck-has-made-me-realise-the-error-of-my-ways/ |access-date=2024-10-01 |work=PC Gamer |language=en}} Video games designed for PAL markets, before the sixth generation of video game consoles, had lower frame rates by design due to the 50 Hz output. This noticeably made fast-paced games, such as racing or fighting games, run slower{{Cite web |last1=Writer |first1=John Linneman Senior Staff |last2=Foundry |first2=Digital |date=2018-12-02 |title=PlayStation Classic review: the games are great but the emulation is really poor |url=https://www.eurogamer.net/digitalfoundry-2018-playstation-classic-review |access-date=2024-10-01 |website=Eurogamer.net |language=en}}; less frequently developers accounted for the frame rate difference and altered the game code to achieve (nearly) identical pacing across both regions, with varying degrees of success. Computer monitors marketed to competitive PC gamers can hit 360 Hz, 500 Hz, or more.{{cite web|url=https://www.techradar.com/best/high-refresh-rate-monitors|title=The best high refresh rate monitors 2025: fast displays for gamers|last=Uy|first=Michelle Rae|work=TechRadar|date=2024-07-05|accessdate=2025-01-21}} High frame rates make action scenes look less blurry, such as sprinting through the wilderness in an open world game, spinning rapidly to face an opponent in a first-person shooter, or keeping track of details during an intense fight in a multiplayer online battle arena. Input latency is also reduced.{{cite web|url=https://www.pcworld.com/article/2111796/240hz-is-the-new-120hz-its-time-to-buy-a-high-refresh-rate-monitor.html|title=240Hz is the new 120Hz: It’s time to buy a high refresh rate monitor|last=Smith|first=Matthew S.|work=PC World|date=2023-10-20|accessdate=2025-01-21}} Some people may have difficulty perceiving the differences between high frame rates, though.{{cite web|url=https://www.digitaltrends.com/computing/do-you-need-a-120hz-or-240-hz-monitor/#dt-heading-what-does-hz-actuallymean|title=Do you need a high-refresh gaming monitor?|last=Smith|first=Matthew S.|work=Digital Trends|date=2023-04-24|accessdate=2025-01-21}}

Frame time is related to frame rate, but it measures the time between frames. A game could maintain an average of 60 frames per second but appear choppy because of a poor frame time. Game reviews sometimes average the worst 1% of frame rates, reported as the 99th percentile, to measure how choppy the game appears. A small difference between the average frame rate and 99th percentile would generally indicate a smooth experience. To mitigate the choppiness of poorly optimized games, players can set frame rate caps closer to their 99% percentile.{{cite web|url=https://www.digitaltrends.com/computing/what-is-frame-time/#dt-heading-how-to-improve-frame-time-in-games|title= What is frame time, and why is it so important in games?|last=Roach|first=Jacob|work=Digital Trends|date=2022-10-27|accessdate=2025-01-21}}

When a game's frame rate is different than the display's refresh rate, screen tearing can occur. Vsync mitigates this, but it caps the frame rate to the display's refresh rate, increases input lag, and introduces judder. Variable refresh rate displays automatically set their refresh rate equal to the game's frame rate, as long as it is within the display's supported range.{{cite web|url=https://www.gamesradar.com/vsync-gsync-freesync-explained/|title=VSync, FreeSync, and G-Sync explained - what they are and why they matter for gaming|last=Bradley|first=Alan|work=GamesRadar|date=2019-03-19|accessdate=2025-01-21}}

{{More citations needed|section|date=June 2023}}

{{Multiple image

|direction=vertical

|width=220

|image1=Low frame rate example.gif

|caption1=Low frame rate video

|image2=High frame rate video.gif

|caption2=Video with 4 times increased frame rate}}

Frame rate up-conversion (FRC) is the process of increasing the temporal resolution of a video sequence by synthesizing one or more intermediate frames between two consecutive frames. A low frame rate causes aliasing, yields abrupt motion artifacts, and degrades the video quality. Consequently, the temporal resolution is an important factor affecting video quality. Algorithms for FRC are widely used in applications, including visual quality enhancement, video compression and slow-motion video generation.

Most FRC methods can be categorized into optical flow or kernel-based{{cite conference | last1=Simon | first1=Niklaus| last2=Long | first2=Mai| last3=Feng| first3=Liu | title=Video frame interpolation via adaptive separable convolution | publisher=ICCV | year=2017 | page=| arxiv=1708.01692}}{{cite conference | last1=Huaizu | first1=Jiang| last2=Deqing | first2=Sun| last3=Varun | first3=Jampani| last4=Ming-Hsuan|first4=Yang| last5=Erik |first5=Learned-Miller| last6=Jan|first6=Kautz| title=Super slomo: High quality estimation of multiple intermediate frames for video interpolation | publisher=ICCV | year=2018 | page=| arxiv=1712.00080}} and pixel hallucination-based methods.{{cite conference | last1=Shurui | first1=Gui| last2=Chaoyue | first2=Wang| last3=Qihua | first3=Chen| last4=Dacheng |first4=Tao| title=2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)| chapter=Featureflow: Robust video interpolation via structure-to-texture generation | publisher=IEEE| year=2020 | pages=14001–14010| isbn=978-1-7281-7169-2 | doi=10.1109/CVPR42600.2020.01402 }}{{cite journal | last1=Myungsub | first1=Choi| last2=Heewon | first2=Kim| last3=Bohyung | first3=Han| last4=Ning |first4=Xu| last5=Kyoung |first5=Mu Lee| title=Channel Attention is All You Need for Video Frame Interpolation| journal=Proceedings of the AAAI Conference on Artificial Intelligence| publisher=AAAI| year=2020 | volume=34| issue=7| pages=10663–10671| doi=10.1609/aaai.v34i07.6693 | doi-access=free }}

Flow-based methods linearly combine predicted optical flows between two input frames to approximate flows from the target intermediate frame to the input frames. They also propose flow reversal (projection) for more accurate image warping. Moreover, there are algorithms that give different weights of overlapped flow vectors depending on the object depth of the scene via a flow projection layer.

Pixel hallucination-based methods use deformable convolution to the center frame generator by replacing optical flows with offset vectors. There are algorithms that also interpolate middle frames with the help of deformable convolution in the feature domain. However, since these methods directly hallucinate pixels unlike the flow-based FRC methods, the predicted frames tend to be blurry when fast-moving objects are present.

• Delta timing
• Federal Standard 1037C
• Film-out
• Flicker fusion threshold
• Glossary of video terms
• High frame rate
• List of motion picture film formats
• Micro stuttering
• MIL-STD-188
• Movie projector
• Time-lapse photography
• Video compression

{{Reflist}}

• [https://web.archive.org/web/20011214070700/http://www.microsoft.com/hwdev/archive/TVBROADCAST/TempRate.asp "Temporal Rate Conversion"]—a very detailed guide about the visual interference of TV, video & PC (Wayback Machine copy)
• [http://frames-per-second.appspot.com/ Compare frames per second: which looks better?]—a web tool to visually compare differences in frame rate and motion blur.

{{Video processing}}

{{Graphics Processing Unit}}

{{Compression methods}}

{{Authority control}}

{{DEFAULTSORT:Frame Rate}}

Category:Film and video technology

Category:Temporal rates

Category:Data compression