CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time
  Cognitive Task Solving and Reasoning in UAVs
This paper introduces CognitiveDrone, a novel Vision-Language-Action (VLA)
model tailored for complex Unmanned Aerial Vehicles (UAVs) tasks that demand
advanced cognitive abilities. Trained on a dataset comprising over 8,000
simulated flight trajectories across three key categories-Human Recognition,
Symbol Understanding, and Reasoning-the model generates real-time 4D action
commands based on first-person visual inputs and textual instructions. To
further enhance performance in intricate scenarios, we propose
CognitiveDrone-R1, which integrates an additional Vision-Language Model (VLM)
reasoning module to simplify task directives prior to high-frequency control.
Experimental evaluations using our open-source benchmark, CognitiveDroneBench,
reveal that while a racing-oriented model (RaceVLA) achieves an overall success
rate of 31.3%, the base CognitiveDrone model reaches 59.6%, and
CognitiveDrone-R1 attains a success rate of 77.2%. These results demonstrate
improvements of up to 30% in critical cognitive tasks, underscoring the
effectiveness of incorporating advanced reasoning capabilities into UAV control
systems. Our contributions include the development of a state-of-the-art VLA
model for UAV control and the introduction of the first dedicated benchmark for
assessing cognitive tasks in drone operations. The complete repository is
available at cognitivedrone.github.io
67c92e537ae0115c7a7b9fa3
Artem Lykov
admin_assigned
2025-03-06T14:06:50.855Z
641d7ac93509072bd5c29f23
/avatars/d64661cf7e4159932540c5f9e8f30b31.svg
Artem Lykov
user
ArtemLykov
67c92e537ae0115c7a7b9fa4
Valerii Serpiva
claimed_verified
2025-03-31T08:16:06.659Z
67af5e10977325630584b1aa
/avatars/c722f64ec7816f61dacefa2f1d550cdf.svg
Valerii Serpiva
user
SerValera
67c92e537ae0115c7a7b9fa5
Muhammad Haris Khan
67c92e537ae0115c7a7b9fa6
Oleg Sautenkov
admin_assigned
2025-03-06T14:07:35.797Z
67bde90dd254a3945474bfef
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/uRvk8mrmhy8mNlgEpRpw9.png
Oleg Sautenkov
user
Sauten
67c92e537ae0115c7a7b9fa7
Artyom Myshlyaev
67c92e537ae0115c7a7b9fa8
Grik Tadevosyan
67c92e537ae0115c7a7b9fa9
Yasheerah Yaqoot
admin_assigned
2025-03-06T14:07:22.304Z
67a9c753b225716590053ea5
/avatars/75facb21fe2fb3a8055e15d75cda0ed8.svg
Yasheerah Yaqoot
user
yasheerahyaqoot
67c92e537ae0115c7a7b9faa
Dzmitry Tsetserukou
CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time
  Cognitive Task Solving and Reasoning in UAVs
This paper introduces CognitiveDrone, a novel Vision-Language-Action (VLA)
model tailored for complex Unmanned Aerial Vehicles (UAVs) tasks that demand
advanced cognitive abilities. Trained on a dataset comprising over 8,000
simulated flight trajectories across three key categories-Human Recognition,
Symbol Understanding, and Reasoning-the model generates real-time 4D action
commands based on first-person visual inputs and textual instructions. To
further enhance performance in intricate scenarios, we propose
CognitiveDrone-R1, which integrates an additional Vision-Language Model (VLM)
reasoning module to simplify task directives prior to high-frequency control.
Experimental evaluations using our open-source benchmark, CognitiveDroneBench,
reveal that while a racing-oriented model (RaceVLA) achieves an overall success
rate of 31.3%, the base CognitiveDrone model reaches 59.6%, and
CognitiveDrone-R1 attains a success rate of 77.2%. These results demonstrate
improvements of up to 30% in critical cognitive tasks, underscoring the
effectiveness of incorporating advanced reasoning capabilities into UAV control
systems. Our contributions include the development of a state-of-the-art VLA
model for UAV control and the introduction of the first dedicated benchmark for
assessing cognitive tasks in drone operations. The complete repository is
available at cognitivedrone.github.io
CognitiveDrone is a VLA model for UAVs that improves real-time action command generation in complex scenarios through the use of a reasoning module, achieving enhanced performance on cognitive tasks with the CognitiveDrone-R1 version.
vision-language-action model unmanned aerial vehicles real-time action commands vision-language model reasoning module CognitiveDroneBench benchmark cognitive tasks UAV control systems