Withdraw
Loading…
CONTROL SOFTWARE VISION SYSTEM
Heyi Tao
Loading…
Permalink
https://hdl.handle.net/2142/114896
Description
- Title
- CONTROL SOFTWARE VISION SYSTEM
- Author(s)
- Heyi Tao
- Issue Date
- 2022-05
- Keyword(s)
- Multi-Task Learning; Software Games Controlling; Computer Vision
- Abstract
- Ever since the development of machine learning and deep learning, people are trying to implement thatknowledge into many fields in humans’ daily lives, and game playing is among one of them. Training an AI agent that could outperform human players can in turn teach people optimize different processes in other complicated subfields. In this paper, we explore the possibilities for developing a program by utilizing Transformer architecture in the computer vision field, called Control Software Vision System, that could potentially understand the interface of different kinds of simple software games and perform corresponding actions to interact with them. For example, the system could potentially push the button with the correct shape if the interface provides critical information to indicate which button should be pressed. While computer vision system could complete certain software games’ tasks fairly easily, sometimes it would have serious troubles to reason about the logic of the games that seems easy for humans. As a result, our system could interact with some software programs while we learned some limitations a computer vision system would have in reasoning the logic of games. In general, our current research offers several promising solutions using computer vision methods to interact with different kinds of simple software games and could be further generalized to other games using similar methods, which provides foundations for creating a vision system that could potentially interact with various softwares, even some of them that have never been trained before.
- Type of Resource
- text
- Language
- en
- Handle URL
- https://hdl.handle.net/2142/114896
Owning Collections
Senior Theses - Electrical and Computer Engineering PRIMARY
The best of ECE undergraduate researchManage Files
Loading…
Edit Collection Membership
Loading…
Edit Metadata
Loading…
Edit Properties
Loading…
Embargoes
Loading…