ellibsЭлектронные библиотекиRussian Digital Libraries Journal1562-5419Казанский (Приволжский) федеральный университет10.26907/1562-5419-2024-27-4-478-502ellibs-559Research ArticleСтатьиПрограммное средство оптимизации процессов видеопроизводстваSoftware Tool for Videoproduction OptimisationДавлетшинРустем ФаридовичDavletshinRustem Faridovichrustemd02@mail.ruШаховаИрина СергеевнаShakhovaIrina Sergeevnais@it.kfu.ruКазанский (Приволжский) федеральный университетKazan (Volga region) Federal University202428052025274478502Copyright © Давлетшин Р.Ф., Шахова И.С., 20252025Давлетшин Р.Ф., Шахова И.С.Davletshin R.F., Shakhova I.S.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://ellibs.elpub.ru/jour/article/view/559

Предложены программные механизмы, направленные на оптимизацию процессов видеопроизводства для авторов художественных видеоматериалов – материалов, предполагающих предварительную постановочную работу. Разработан механизм создания анимированных трехмерных планов съемки (раскадровок) с использованием дополненной реальности для позиционирования и анимации перемещения актеров. С целью преодоления ограничений операционной системы iOS, связанных с доступом к сенсорам, разработан механизм раздельного захвата аудио- и видеопотоков с датчиков устройства для проведения записи, а также их последующей синхронизации по временным меткам для сохранения в память устройства. Отслеживание соблюдения правил композиционного построения и анализ качества изображения на предмет расфокусировки камеры реализованы с использованием технологий компьютерного зрения. Также представлены механизмы работы со сценарием, включающие алгоритмы обработки текста для вывода на экран в виде субтитров, а также распознавания речи актеров и сравнения её с текстом сценария.

The paper proposes software mechanisms aimed at enhancing video production processes for the authors of artistic video materials. We propose a mechanism for creating animated three-dimensional shooting plans (storyboards) using augmented reality to position and animate the movement of actors. In order to overcome the limitations of the iOS operating system related to access to sensors, we developed a mechanism for separately capturing audio and video streams from device sensors for recording and their subsequent synchronization by timestamps for saving to device memory. Computer vision technologies are used to ensure compliance with the rules of compositional construction and image quality analysis. The paper also presents mechanisms for working with the script, including text processing algorithms for displaying subtitles on the screen, and speech recognition algorithms for comparing speech recognition of actors with the text of the script.

видеопроизводствомобильное кинодополненная реальностьраскадровкавидеозаписьавтоматизацияпрограммное решениеvideo productionmovie makingmobile cinemaaugmented realitystoryboardvideo recordingsautomationsoftware solutionReferencesWang H., Yang S., Dai Z. The Development of Mobile Short Video Communication in the Context of the Mobile Internet // Science Insights. 2022. Vol. 40. No. 1. P. 421–426. URL: https://doi.org/10.15354/si.22.re011.Wang H., Yang S., Dai Z. The Development of Mobile Short Video Communication in the Context of the Mobile Internet // Science Insights. 2022. Vol. 40. No. 1. P. 421–426. URL: https://doi.org/10.15354/si.22.re011.The Rise of Mobile Filmmaking: A New Era of Cinematic Expression // ECGProductions. 2023. URL: https://www.ecgprod.com/the-rise-of-mobile-filmmaking/.The Rise of Mobile Filmmaking: A New Era of Cinematic Expression // ECGProductions. 2023. URL: https://www.ecgprod.com/the-rise-of-mobile-filmmaking/.Blahnik V., Schindelbeck O. Smartphone imaging technology and its applications // Advanced Optical Technologies. 2021. Vol. 10, No. 3. P. 145–232. URL: https://doi.org/10.1515/aot-2021-0023.Blahnik V., Schindelbeck O. Smartphone imaging technology and its applications // Advanced Optical Technologies. 2021. Vol. 10, No. 3. P. 145–232. URL: https://doi.org/10.1515/aot-2021-0023.Smartphones vs Cameras: Closing the gap on image quality // DxOMark. 2021. URL: https://www.dxomark.com/smartphones-vs-cameras-closing-the-gap-on-image-quality/.Smartphones vs Cameras: Closing the gap on image quality // DxOMark. 2021. URL: https://www.dxomark.com/smartphones-vs-cameras-closing-the-gap-on-image-quality/.Schleser M. Smartphone filmmaking: theory and practice. // Bloomsbury Publishing USA. 2021. P. 8–10.Schleser M. Smartphone filmmaking: theory and practice. // Bloomsbury Publishing USA. 2021. P. 8–10.Friis I., Hansen A. Line-item budgeting and film-production: Exploring some benefits of budget constraints on creativity // Qualitative Research in Accounting & Management. 2015. Vol. 12, No. 4. P. 321–345. URL: https://doi.org/10.1108/QRAM-01-2015-0016.Friis I., Hansen A. Line-item budgeting and film-production: Exploring some benefits of budget constraints on creativity // Qualitative Research in Accounting & Management. 2015. Vol. 12, No. 4. P. 321–345. URL: https://doi.org/10.1108/QRAM-01-2015-0016.Balaban O., Levchenko O., Krupskyy I., Medvedieva A., Mykhalov V. Script Structures in Modern Audio-Visual Art // Studies in Media and Communication. 2021. Vol. 9, No. 2. P. 45–50. URL: https://doi.org/10.11114/smc.v9i2.5386.Balaban O., Levchenko O., Krupskyy I., Medvedieva A., Mykhalov V. Script Structures in Modern Audio-Visual Art // Studies in Media and Communication. 2021. Vol. 9, No. 2. P. 45–50. URL: https://doi.org/10.11114/smc.v9i2.5386.Brown B. Cinematography: Theory and Practice. 2016. P. 28–44.Brown B. Cinematography: Theory and Practice. 2016. P. 28–44.LightSpace – 3D painting in air. URL: https://apps.apple.com/ru/app/lightspace-3d-painting-in-ar/id1274597316.LightSpace – 3D painting in air. URL: https://apps.apple.com/ru/app/lightspace-3d-painting-in-ar/id1274597316.Storyboard Animator. URL: https://apps.apple.com/ru/app/storyboard-animator/id1326518944.Storyboard Animator. URL: https://apps.apple.com/ru/app/storyboard-animator/id1326518944.SUFLER.PRO. URL: https://apps.apple.com/ru/app/sufler-pro/id1480258675.SUFLER.PRO. URL: https://apps.apple.com/ru/app/sufler-pro/id1480258675.Shaner P. Digital Filmmaking: An Introduction. // Mercury Learning and Information. 2011. P. 34–50.Shaner P. Digital Filmmaking: An Introduction. // Mercury Learning and Information. 2011. P. 34–50.Get live captions in real time on iPhone. URL: https://support.apple.com/en-in/guide/iphone/iphe0990f7bb/ios.Get live captions in real time on iPhone. URL: https://support.apple.com/en-in/guide/iphone/iphe0990f7bb/ios.Providing 3D virtual content with SceneKit. URL: https://developer.apple.com/documentation/arkit/arscnview/providing3dvirtualcontentwith_scenekit.Providing 3D virtual content with SceneKit. URL: https://developer.apple.com/documentation/arkit/arscnview/providing3dvirtualcontentwith_scenekit.ARKit Documentation. URL: https://developer.apple.com/documentation/ arkit/.ARKit Documentation. URL: https://developer.apple.com/documentation/ arkit/.Improving the performance of a RealityKit app. URL: https://developer.apple.com/documentation/realitykit/improving-the-performance-of-a-realitykit-app.Improving the performance of a RealityKit app. URL: https://developer.apple.com/documentation/realitykit/improving-the-performance-of-a-realitykit-app.SIMD Float4x4. URL: https://developer.apple.com/documentation/ accelerate/simd_float4x4.SIMD Float4x4. URL: https://developer.apple.com/documentation/ accelerate/simd_float4x4.Saito T., Toriwaki J.I. New algorithms for euclidean distance transformation of an n-dimensional digitized picture with applications // Pattern Recognition. 1994. Vol. 27, No. 11. P. 1551–1565.Saito T., Toriwaki J.I. New algorithms for euclidean distance transformation of an n-dimensional digitized picture with applications // Pattern Recognition. 1994. Vol. 27, No. 11. P. 1551–1565.ARWorldMap. URL: https://developer.apple.com/documentation/arkit/ arworldmap.ARWorldMap. URL: https://developer.apple.com/documentation/arkit/ arworldmap.PhotoKit. URL: https://developer.apple.com/documentation/photokit.PhotoKit. URL: https://developer.apple.com/documentation/photokit.Cinematography Techniques: The Different Types. URL: https://rudafilms.com/gallery/Cinematography%20Techniques%20The%20Different%20Types.pdf.Cinematography Techniques: The Different Types. URL: https://rudafilms.com/gallery/Cinematography%20Techniques%20The%20Different%20Types.pdf.Speech. URL: https://developer.apple.com/documentation/speech.Speech. URL: https://developer.apple.com/documentation/speech.

The authors declare that there are no conflicts of interest present.