-->
Home
Posts

ExoSkeleton Bionic Arm using Voice Commands

01. Project Title : Exo-Skeleton ( Bionic Arm ) using Voice Commands for the Physically  Challenged People.


02. Idea Theme : Revolutionizing prosthetics: A cost-affordable Bionic Arm with Voice Recognition for enhanced functionality and inclusivity.


 03. Introduction :

The development of the Voice-Controlled Exo-Skeleton Bionic Arm represents a groundbreaking innovation in the field of prosthetics, aiming to revolutionize the lives of physically challenged individuals. Traditional prosthetic limbs have come a long way, but they often lack the intuitiveness and advanced functionality necessary to provide a seamless experience for users. This project sets out to address these limitations by incorporating cutting-edge technologies such as voice recognition, force sensing, and object detection, ensuring a more natural and inclusive user experience.

The key objective of this project is to create a cost-affordable Bionic Arm that goes beyond conventional prosthetics, providing enhanced functionality and improved control through the integration of voice commands. By empowering users to operate the Bionic Arm hands-free and intuitively, we aim to restore a sense of independence and autonomy to those with limb impairments.

Moreover, this innovation embraces inclusivity by catering to the needs of individuals who are deaf or mute. The addition of obstacle detection features further ensures the safety of users, enabling the Bionic Arm to navigate its surroundings with ease and preventing collisions.


04. Motivation : Our motivation for developin the Bionic Arm with Voice Recognition is driven by the belief that technology can profoundly impact lives. By combining a prosthetic limb with voice commands, we aim to empower individuals with disabilities, enabling them to interact with their environment more intuitively and confidently. Our goal is to bridge the gap between human potential and technology, creating an inclusive and accessible solution that enhances independence and quality of life. We are inspired by the opportunity to make a real difference, assisting those with limb loss, speech impairments, or sensory challenges. Our commitment to excellence ensures a reliable, affordable, and transformative system. Through this innovation, we envision a future where technology fosters empowerment and compassion for all.


05. Newness/uniqueness of the innovation : The voice-controlled Exo-Skeleton Bionic Arms are a revolutionary aspect of the planned advancement in prosthetics. The main control method is voice commands, which improves user involvement and experience. Obstacle detection allows for safe object manipulation and navigation for those who are deaf or mute. Functionality is improved by precise force sensing, which enables deft handling and firm grip. This cutting-edge system offers inclusivity, intuitiveness, and independence by combining voice commands, obstacle detection, and force sensing. It is a big step forward for prostheses, specifically catering to the need of those who are deaf or dumb.

 

1. Voice Recognition Integration: By combining voice commands with prosthetic limb control, this innovation offers a hands-free and intuitive approach, enabling users to effortlessly operate the Bionic Arm.

 

2. Force Sensing Capabilities: The integration of force sensors allows the Bionic Arm to accurately sense and adjust its grip strength based on the force applied to objects, providing delicate control for fragile items and a firm grip for heavier objects.

 

3. Object Detection and Obstacle Avoidance: The inclusion of ultrasonic sensors and Time-of-Flight (ToF) sensors enables the Bionic Arm to detect objects and obstacles in its surroundings, enhancing user safety and autonomy by allowing the arm to navigate around obstacles.

 

4. Inclusive Technology: The Bionic Arm with Voice Recognition caters to individuals with disabilities, including those who are deaf, blind, or have speech impairments. By offering customizable control through voice commands, it ensures inclusivity and empowers a wider range of users to benefit from its advanced features.

 

5. Comprehensive Feedback System: The Bionic Arm provides real-time feedback to the user through visual, auditory, or haptic cues, informing them when an object has been successfully grasped or alerting them to potential obstacles, ensuring a seamless and safe user experience.

 

6. Micro Controller-Based Control System: The integration of a Micro Controller board as the central control unit enables seamless communication and coordination between the various components, ensuring efficient and precise control over the Bionic Arm's movements and functionalities.

 

7. Customizable and Adaptive: The Bionic Arm offers customization options to adapt to individual needs and preferences. Users can calibrate the system for accurate voice recognition, fine-tune the code, and optimize sensor performance to achieve personalized control and comfort.

 

8. Groundbreaking Technological Advancement: This innovation represents a groundbreaking advancement in the field of prosthetics, combining multiple features such as voice control, force sensing, and object detection in a cost-affordable solution that enhances functionality and independence for individuals with limb impairments.

 

Overall, the combination of voice commands, force sensing, and Object detection in the voice-controlled Exo-Skeleton Bionic Arm brings unprecedented functionality and inclusivity to the field of prosthetics, providing a more intuitive and safe user experience while specifically addressing the needs of individuals who are deaf or mute.

 

06. Novelty: The proposed innovation offers a unique combination of novel features and advancements in the field of prosthetics, including voice-controlled Exo-Skeleton Bionic Arms, cost affordability, and assistance for individuals who are blind with obstacle and object detection. The key areas of novelty are as follows:

 

1. Voice Commands for Intuitive Control: Unlike traditional control methods, such as manual control or external devices, this innovation introduces voice commands as the primary mode of control. By integrating voice recognition technology, it provides users with a more natural, intuitive, and hands-free approach to operating the Bionic Arm, enhancing user experience and control.

 

2. Object and Obstacle Detection for Blind and Speech-Impaired Individuals: The inclusion of object and obstacle detection capabilities in this innovation is particularly beneficial for individuals who are blind or have speech impairments. By incorporating ultrasonic sensors and relevant technologies, the Bionic Arm can detect objects and obstacles in real-time, enabling blind individuals to navigate their environment safely. Additionally, individuals who cannot speak can also benefit from the system's object and obstacle detection, providing them with increased independence and mobility.

 

3. Precise Force Sensing for Enhanced Manipulation: The integration of precise force sensing capabilities sets this innovation apart from others. The Bionic Arm accurately detects the force required for object manipulation, allowing users to handle delicate items with finesse and apply appropriate force for heavier objects. This level of control and adaptability enhances functionality, dexterity, and user satisfaction, providing a more natural and responsive experience compared to traditional prosthetic limbs that lack such precise force sensing capabilities.

 

Through its cost affordability, intuitive voice commands, object and obstacle detection for blind individuals, and precise force sensing capabilities, this innovation presents a comprehensive and differentiated solution in the field of prosthetics. By addressing cost barriers, providing intuitive control, enhancing safety for the blind, and improving manipulation capabilities, it offers a unique and advanced prosthetic limb option with enhanced functionality and inclusivity.

 

07. Concept & Objective :

 

Concept:

The concept behind the Bionic Arm with Voice Recognition is to create a prosthetic limb that integrates advanced technologies such as voice recognition, force sensing, object detection, and obstacle avoidance. By combining these features, the Bionic Arm offers enhanced functionality, intuitive control, and inclusivity for individuals with disabilities. The integration of these technologies in a cost-affordable manner ensures accessibility and provides a comprehensive solution for prosthetic limb users.

 

Objectives:

The primary objectives of the Bionic Arm with Voice Recognition are as follows:

 

1. Cost Affordability: This innovation prioritizes cost effectiveness, making advanced prosthetic limb technology more accessible to a wider range of individuals. By offering a cost-affordable solution, it addresses a significant barrier that often restricts individuals from accessing cutting-edge prosthetic technologies.

 

2. User Friendly: The Bionic Arm with Voice Recognition is not only a groundbreaking innovation in prosthetics but also a user-friendly solution. With intuitive voice commands, customizable control, clear feedback mechanisms, and an ergonomic design, users can effortlessly operate the arm. Its user-centric approach enhances usability, ensuring a seamless and satisfying experience for individuals with limb impairments.

 

3. Develop a voice recognition system: Create an accurate and reliable voice recognition system that can interpret specific voice commands associated with different arm movements, force levels, and feedback cues. This system should enable real-time interaction and control of the prosthetic limb.

 

4. Implement force sensing capabilities: Integrate force sensors into the Bionic Arm to enable it to sense and adjust its grip strength based on the force applied to objects. This feature allows for delicate handling of fragile objects and a firmer grip for heavier items, providing users with precise control and a natural feel.

 

5. Integrate object detection and obstacle avoidance: Incorporate ultrasonic sensors and Time-of-Flight (ToF) sensors into the Bionic Arm to detect objects and obstacles in the arm's vicinity. This functionality enhances user safety by enabling the arm to avoid collisions and navigate around obstacles autonomously.

 

6. Ensure seamless communication, precise control, and customization: The Bionic Arm with Voice Recognition establishes seamless communication and coordination between its components, allowing for precise control over movements and real-time voice command recognition. It offers customization options for users to adapt the arm to their needs and preferences. Thorough testing and calibration ensure accurate performance, reliable features such as force sensing, object detection, and obstacle avoidance, and a seamless user experience.

 

By achieving these objectives, the Bionic Arm with Voice Recognition aims to revolutionize the field of prosthetics by offering an affordable, intuitive, and inclusive solution that empowers individuals with disabilities, enhancing their functionality, control, and independence.

 

08. Specify the potential areas of application in industry/market in brief :

 

The Bionic Arm with Voice Recognition has a wide range of potential applications across various industries and markets. Some of the key areas where this innovative technology can be applied include:

 

1. Medical Rehabilitation: The Bionic Arm can be utilized in medical rehabilitation settings to assist individuals who have experienced limb loss or limb impairment. Its advanced features, such as voice-controlled operation, force sensing, and object detection, can significantly enhance the rehabilitation process and help individuals regain functional independence.

 

2. Assistive Technology: The Bionic Arm can serve as an assistive device for individuals with disabilities, including those with limb impairments, speech impairments, or sensory disabilities. By integrating voice recognition and intuitive control, it offers an inclusive solution that empowers individuals to perform daily tasks and improve their quality of life.

 

3. Industrial Manufacturing: The precise control and force sensing capabilities of the Bionic Arm make it well-suited for industrial manufacturing applications. It can be used to manipulate delicate or heavy objects with precision, increasing productivity and efficiency in manufacturing processes.

 

4. Aerospace and Defense: The Bionic Arm can find applications in aerospace and defense industries, particularly in tasks that require fine motor skills and dexterity. Its ability to adapt grip strength and detect objects or obstacles makes it valuable in handling sensitive equipment or performing complex tasks in challenging environments.

 

5. Robotics and Automation: The Bionic Arm's integration with voice recognition, force sensing, and object detection technologies positions it as a valuable component in robotic systems. It can be utilized in robotics and automation applications, where human-like control and adaptability are required for tasks such as pick-and-place operations or human-robot collaboration.

 

6. Prosthetics Industry: The Bionic Arm represents an advancement in the field of prosthetics, offering a cost-affordable alternative with enhanced functionality. It can be integrated into the prosthetics industry, providing individuals with limb impairments access to a comprehensive and intuitive prosthetic limb control system.

 

These application areas demonstrate the versatility and potential impact of the Bionic Arm with Voice Recognition across various industries, showcasing its ability to improve functionality, control, and inclusivity in diverse settings.

 

09. Briefly provide the market potential of idea/innovation :

 

The market potential for the Bionic Arm with Voice Recognition is significant due to several factors:

 

1. Growing Demand: The demand for advanced prosthetic limb solutions is increasing, driven by factors such as an aging population, an increase in limb impairments due to accidents or medical conditions, and a rising focus on improving the quality of life for individuals with disabilities.

 

2. Accessibility and Affordability: The Bionic Arm's cost-effective design makes it accessible to a broader market segment, overcoming one of the major barriers to adoption in the prosthetics industry. This affordability factor can attract a larger customer base, including individuals who may have previously been unable to afford advanced prosthetic limb technologies.

 

3. Inclusive Features: The integration of voice recognition, force sensing, and object detection in the Bionic Arm offers inclusive features that cater to a wide range of disabilities. This inclusivity not only expands the potential user base but also positions the product as a highly desirable solution in the assistive technology market.

 

4. Enhanced Functionality and Control: The advanced features of the Bionic Arm, such as precise control, adaptive grip strength, and obstacle detection, provide users with an improved level of functionality and control over their prosthetic limb. This heightened capability addresses the needs and aspirations of individuals seeking advanced prosthetic technologies.

 

5. Industry Adoption and Partnerships: The innovation and unique features of the Bionic Arm make it an attractive prospect for partnerships with healthcare providers, rehabilitation centers, prosthetic limb manufacturers, and assistive technology companies. Such collaborations can drive market penetration and facilitate widespread adoption of the technology.

 

6. Emerging Technological Advancements: The integration of voice recognition, sensor technologies, and control systems in the Bionic Arm aligns with the ongoing advancements in artificial intelligence, robotics, and smart prosthetics. This alignment positions the innovation at the forefront of emerging trends, attracting attention and interest from industry players and investors.

 

Overall, the Bionic Arm with Voice Recognition has a promising market potential due to its affordability, inclusivity, advanced features, and alignment with emerging technological trends. The combination of these factors creates opportunities for market expansion, partnerships, and improved quality of life for individuals with limb impairments.

 

10. Expected time of completion of idea [12 months] :

 

Phase

Duration

Description

Planning

2 month

Define project objectives, requirements, and establish the overall project plan.

Design &

Development

6

months

Create the design specifications, including the integration of voice control, force sensing, and Object detection components.

Implement the hardware and software components, including the Micro Controller board, servo motors, force sensors, ultrasonic sensors, and voice recognition module.

Testing & Iteration

2 month

Conduct thorough testing of the system's functionality, performance, and integration.

Refinement

1 month

Incorporate feedback from testing phase and make necessary adjustments to improve the design and functionality.

Finalization

1 month

Complete documentation, finalize the system, and prepare for deployment.

 

Phase

Month1

Month2

Month3

Month4

Month5

Month6

Month7

Month8

Month9

Month10

Month11

Month12

Planning

 

 

 

 

 

 

 

 

 

 

 

 

 

Design & Development

 

 

 

 

 

 

 

 

 

 

 

 

Testing & Iteration

 

 

 

 

 

 

 

 

 

 

 

 

Refinement

 

 

 

 

 

 

 

 

 

 

 

 

 

Finalization

 

 

 

 

 

 

 

 

 

 

 

 

 

 

11. Progress : The project, Exo-Skeleton Bionic Arm, was showcased at the successful

IITEX Expo (2023) supported by MSME in Hi-Tech City from 28/06/2023 to 30/06/2023. It garnered significant attention from attendees, including professionals, researchers, and investors. We received positive feedback and encouragement for our groundbreaking innovation.

 

We firmly believe that the project holds immense potential for research and development, with your guidance and support. We are confident that we can make significant contributions for this project.

 

12. Prototype :



Figure 1 Basic Model of Exo-Skelton Bionic Arm 

13. Block Diagram :



Fig 2 : Block Diagram of Exo Skeleton Bionic Arm

14. Circuit Diagram :


Figure 3 Circuit Diagram Exo-Skelton Bionic Arm

15. Methodology :

 

1. Hardware Setup: In addition to connecting the VoiceRecognitionModule and servo motors, connect the TOF sensors to the Micro Controller board.

 

2. Initialization: Initialize the VoiceRecognitionModule, servo motors, and TOF sensors.

 

3. Loading Gestures: Load pre-defined gesture commands into the VoiceRecognitionModule.

 

4. Main Loop: Continuously check for voice recognition commands using the VoiceRecognitionModule.

 

5. Gesture Execution: Trigger servo motors based on the recognized gesture index. Additionally, use the TOF sensors to detect Objects or measure distances.

 

6. Feedback and Print Results: Provide feedback through the serial monitor and print recognized gesture details. Include information from the TOF sensors, such as Object detection or distance measurements.

 

7. Repeat: Continuously recognize voice commands, execute corresponding actions with servo motors, and use TOF sensors for Object detection or distance measurements.

 

8. Platform: Develop the project on the Micro Controller platform, leveraging its libraries and functions for controlling servo motors and interfacing with TOF sensors.

 

By integrating TOF sensors into the methodology, the robotic Exo-Skeleton gains the capability to detect Objects or measure distances. This information can be used to adapt the movements or actions of the servo motors in response to the environment.

 

16. Critical Review of the Latest Status of the Technology:

 

State of the Nation Report:

 

Voice-controlled Exo-Skeleton Bionic Arms with force sensing and Object detection capabilities are still in the early phases of development and acceptance on a national scale. Although there have been improvements made to functionality and usability, voice control, force sensing, and Object detection are still not fully integrated into bionic arms.

Funding restrictions and the necessity for interdisciplinary cooperation are Objects.

 

Review of the International Status :

 

Voice-controlled bionic arms with force sensing and Object detection capabilities are attracting increasing interest and investment on a global scale. Research focuses on enhancing Object detection systems, force sensing technology, and voice recognition. Collaboration and knowledge exchange between researchers around the world quicken progress. Cost-effectiveness, consumer approval, and long-term dependability are issues.

 

17. Literature Review :

 

S.No

Title

Source

Findings

Design

1

Efficient Self-Attention Model for Speech Recognition-Based Assistive Robots Control

Poirier, Samuel, et al. "Efficient Self-Attention Model for Speech Recognition-Based Assistive Robots Control." Sensors 23.13 (2023): 6056.

1.     Unilingual Commands (French Language)

2.     For a user it is a complex task to manage with Keyword spotting(KWS), Google Speech Commands Dataset (GSCD), French Speech Commands Dataset (FSCD), and Transfer Learning(TL).

3.     A Speaker-dependent Algorithm Dynamic Time Warping and K-Nearest Neighbor.

4.     Operated with buttons to select modes(4 modes available) later on using voice commands

5.     (Ex : In the “Rotation” mode, the available vocabulary is up, down, forward, backward, left, right, plus, minus, open and close)

6.     It is impossible to detect objects or obstacles.

1.     This cannot be worn by a user.

2.     2 Fingers, Elbow and Shoulder

2

Voice-Controlled, Robotic FLEXotendon Glove-II System for Spinal Cord Injury

Tran, Phillip, et al. "Patient-specific, voice-controlled, robotic flexotendon glove-ii system for spinal cord injury." IEEE Robotics and Automation Letters 5.2 (2020): 898-905.

It’s an application of voice recognition module but limited to the people with spinal cord injury( the people who have arm and fingers  but struggling to access the fingers)

1.     It is impossible to detect objects or obstacles.

 

2.     It has three motorised strings attached to the thumb, index, and middle fingers of the glove.

3

Lio-A Personal Robot Assistant for Human-Robot Interaction and Care Applications

Mišeikis, Justinas, et al. "Lio-a personal robot assistant for human-robot interaction and care applications." IEEE Robotics and Automation Letters 5.4 (2020): 5339-5346.

It’s an application of voice recognition module but limited to the medical use in the sense it’s a type of a robot which can be operated through the voice commands or speech recognition.

1.     Not user friendly.

2.     Limited to certain actions.

3.     It is possible to detect objects or obstacles.

4.     This cannot be worn by a user.

5.     Two fingers attached to the gaint robotic arm

4

Smart Prosthetic Hand

Kumar, Nalliboyina Yuva Raja Phani, and Maria Dayana LN. "Design and Implementation of a Smart Prosthetic Hand."

1.     Computational methods like brain, gesture, and voice signals to operate a robotic arm.

2.     Voice commands could be sent through Bluetooth.

3.     In existing model they are going to work on speech recognition module which will effectively capture the data by responding to vocal commands.

4.     This project is Limited to the fingers only.

5.     Not user friendly.

5

WEARABLE ROBOTIC DEVICES DESIGNED FOR FLEXIBILITY AND POWER ASSISTING VOICE COMMANDS USING CATIA V5

Shafee, S. M., et al. "A STUDY OF WEARABLE ROBOTIC DEVICES DESIGNED FOR FLEXIBILITY AND POWER ASSISTING VOICE COMMANDS USING CATIA V5."

1.     Operated through voice commands and flex sensors.

2.     It just affects the elbow, not the palm or fingers.

3.     It is limited to paralyzed Individuals.

6

Developing and modeling of voice control system for prosthetic robot arm in medical systems

Gundogdu, Koksal, Sumeyye Bayrakdar, and Ibrahim Yucedag. "Developing and modeling of voice control system for prosthetic robot arm in medical systems." Journal of King Saud University-Computer and Information Sciences 30.2 (2018): 198-205.

1.     Operated using voice commands.

2.     Force-sensing and obstacle or object detection abilities are absent.

1.     This cannot be worn by a user.

2.     2 Fingers, Elbow and Shoulder

7

VOICE CONTROLLED ROBOTIC ARM

Salim, Abhinav, et al. "Voice controlled robotic arm." International Research Journal of Engineering and Technology 4.04 (2017): 2121-2124.

1.     Operated using voice commands.

2.     Force-sensing and obstacle or object detection abilities are absent.

8

Improved Prosthetic Hand Control with Synchronous Use of Voice Recognition and Inertial Measurements

Alkhafaf, Omer Saad, Mousa K. Wali, and Ali H. Al-Timemy. "Improved prosthetic hand control with synchronous use of voice recognition and inertial measurements." IOP Conference Series: Materials Science and Engineering. Vol. 745. No. 1. IOP Publishing, 2020.

1.     Operated using voice commands and foot controller.

2.     Force-sensing and obstacle or object detection abilities are absent.

3.     Absence of wrist Mechanism.

4.     11 movements only with 99.0% of accuracy

5.     The future plan is; test the control systems on amputees, increase the number of voice commands, and develop the foot controller to enhance the number of active movements.

1.     This cannot be worn by a user.

Figure 1 foot controller

9

Voice Recognition and Inverse Kinematics Control for a Redundant Manipulator Based on a Multilayer Artificial Intelligence Network

Anh, Mai Ngoc, and Duong Xuan Bien. "Voice recognition and inverse kinematics control for a redundant manipulator based on a multilayer artificial intelligence network." Journal of Robotics 2021 (2021): 1-10.

1.     Operated using voice commands via laptop.

2.     Force-sensing and obstacle or object detection abilities are absent.

 

 

10

VOICE RECOGNITION FOR PROSTHETIC CONTROL CASE STUDY

Towers, Kevin, Kevin Barnes, and Craig Wallace. "Voice recognition for prosthetic control case study." Myoelectric Symposium.

1.     Operated using voice commands.

2.     Force sensing and obstacle or object detection abilities are absent.

11

a voice-controlled prosthetic hand

Asyali, Musa Hakan, et al. "Design and implementation of a voice-controlled prosthetic hand." Turkish Journal of Electrical Engineering and Computer Sciences 19.1 (2011): 33-46.

1.     No Wrist Mechanism

2.     uttered voice command is not recognized by the controller due to noise problems, for instance, the prosthetic hand will simply perform no action

3.     unable to wear

4.     it is restricted to three fingers.

5.     existing  design is limited by recognition capability of just 2 commands, namely pick up and release.

 

12

Voice Command Decoding for Position Control of Jaco Robot Arm using a Type-2 Fuzzy Classifier

 

Paul, Ipsita, Sayantani Ghosh, and Amit Konar. "Voice Command decoding for position control of Jaco robot arm using a type-2 fuzzy classifier." 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT). IEEE, 2020.

1.     uttered five basic English language words, `hello', `up', `down', `left' and `right', each of which is associated with the movement of the robotic arm in a specific direction

 

13

Improved hand prostheses control for transradial amputees based on hybrid of voice recognition and electromyography

Alkhafaf, Omer Saad, Mousa K. Wali, and Ali H. Al-Timemy. "Improved hand prostheses control for transradial amputees based on hybrid of voice recognition and electromyography." The International Journal of Artificial Organs 44.7 (2021): 509-517.

01.   each strategy had different number of movements depending on the combination protocol between voice and EMG control systems

 

 

18. Conclusion : In conclusion, the Bionic Arm with Voice Recognition represents a groundbreaking innovation in the field of prosthetics, offering an affordable and inclusive solution for individuals with limb impairments. By integrating voice commands, force sensing, object detection, and obstacle avoidance capabilities, this technology revolutionizes prosthetic limb control and functionality. Its potential applications span across medical rehabilitation, assistive technology, industrial manufacturing, aerospace and defense, robotics, and the prosthetics industry. With growing demand, enhanced functionality, and market partnerships, the Bionic Arm has a promising market potential. It empowers individuals to regain independence, perform daily tasks, and improve their quality of life, highlighting the transformative impact of this cost-effective and inclusive prosthetic limb innovation.

Post a Comment