CN114926573A - Somatosensory shadow particle interactive wall system - Google Patents
Somatosensory shadow particle interactive wall system Download PDFInfo
- Publication number
- CN114926573A CN114926573A CN202210553475.8A CN202210553475A CN114926573A CN 114926573 A CN114926573 A CN 114926573A CN 202210553475 A CN202210553475 A CN 202210553475A CN 114926573 A CN114926573 A CN 114926573A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- grid
- model
- particle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—Three-dimensional [3D] animation
- G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Processing Or Creating Images (AREA)
Abstract
本发明属于体感互动技术领域，公开了一种体感人影粒子互动墙系统，包括：互动画面展示单元、数据采集单元；数据采集单元包括：雷达采集模块和Kinect采集模块；雷达采集模块和Kinect采集模块均与程序模型连接，程序模型用粒子系统结合模型动画来完成展示。本发明主要由互动画面展示单元、数据采集单元构成，其中数据采集单元用于采集人体数据，将数据处理后，通过互动画面展示单元进行展示，数据采集单元主要有雷达采集模块和Kinect采集模块构成，利用雷达设备对参与者的动作进行捕捉，然后将捕捉到的动作上传到相位系统分析，分析得到的数据再结合互动系统，最终产生互动效���，提高了数据采集的敏捷性和数据处理的效率，提高用户体验感。
The invention belongs to the technical field of somatosensory interaction, and discloses a somatosensory human shadow particle interactive wall system, comprising: an interactive screen display unit and a data acquisition unit; the data acquisition unit includes: a radar acquisition module and a Kinect acquisition module; a radar acquisition module and a Kinect acquisition module Both are connected with the procedural model, and the procedural model is displayed with a particle system combined with model animation. The invention is mainly composed of an interactive screen display unit and a data acquisition unit, wherein the data acquisition unit is used for collecting human body data, and after the data is processed, it is displayed through the interactive screen display unit, and the data acquisition unit is mainly composed of a radar acquisition module and a Kinect acquisition module. , use radar equipment to capture the movements of the participants, and then upload the captured movements to the phase system for analysis, and then combine the analyzed data with the interactive system to finally produce interactive effects, improving the agility of data collection and the efficiency of data processing. , to improve the user experience.
Description
Technical Field
The invention belongs to the technical field of somatosensory interaction, and particularly relates to a somatosensory human image particle interactive wall system.
Background
The form of people is fused into the picture in the form of sand painting, the freely added background effect is supported, the randomly added background picture can be processed by software to become the sand painting effect which can be fused with the shadow of a person, any action of an experiencer can cause the picture to generate the change of the form, and the sand painting particles added with dynamic elements in the traditional Chinese painting are cool and cool. The human image particle special effect is realized, and brand new visual experience is formed by interaction of flowing particles and human image body feeling. Each flame particle moves with you like a butterfly that breaks cocoons dances elegantly, or like a phoenix that nirvana regenerates a bath fire. Each flame particle changes color at any time and can be concave to form more shapes. The experience effect that the action is obtained promptly lets the visitor participate in the sense strong, is the good product that market exhibition attracted the stream of people.
However, the existing somatosensory shadow particle interactive wall has the following defects: the acquisition of human body data is not quick enough, and the data processing is lagged, so that the user experience is poor.
Disclosure of Invention
The invention aims to provide a somatosensory human-image particle interactive wall system to solve the problems that in the prior art, human body data are not collected quickly enough and are processed more lagdly.
In order to achieve the purpose, the invention adopts the following technical scheme:
a somatosensory human shadow particle interactive wall system comprises:
the interactive picture display unit and the data acquisition unit are arranged on the mobile terminal;
the interactive picture display unit is composed of a particle system and a model animation which are built in the Unity;
the data acquisition unit includes: the system comprises a radar acquisition module and a Kinect acquisition module;
the radar acquisition module comprises a space human body coordinate acquisition unit and a space human body skeleton acquisition unit;
the Kinect acquisition module comprises a bone tracking unit, an identity recognition unit and a voice recognition unit;
the radar acquisition module and the Kinect acquisition module are both connected with a program model, and the program model is displayed by combining a particle system with a model animation.
Preferably, the system also comprises a network module, wherein the network module comprises a remote server, a network and a database, and the remote server and the database are connected through the network.
Preferably, the data acquisition unit further comprises: the system comprises a feature extraction module and a perception feature module, wherein the feature extraction module and the perception feature module are connected with the radar acquisition module and the Kinect acquisition module.
Preferably, the interactive picture display unit further includes a mesh deformation module and an initialization mesh module, and the mesh deformation module includes: the method comprises a sample collecting layer, a first-level deformation layer, a second-level deformation layer and a third-level deformation layer.
Preferably, the interactive picture display unit further includes: an input plane image module and an output three-dimensional grid model module.
Preferably, the initialization mesh module and the mesh deformation module are sequentially connected between the input plane image module and the output three-dimensional mesh model module;
and the network module is connected with the grid deformation module, and the grid deformation module is connected with the feature extraction module and the perception feature module.
Preferably, the planar image generation method includes the following steps:
carrying out model data synchronization on the human body coordinate data, the spatial human body skeleton data, the skeleton tracking data, the identity recognition data and the voice recognition data;
performing particle rendering on the synchronized model data;
and outputting the plane image.
Preferably, when outputting the three-dimensional mesh model, the method comprises the following steps:
inputting a plane image;
extracting the characteristics of the plane image from the plane image, and initializing an elliptical grid;
associating the planar image information with the three-dimensional mesh information;
inputting the associated plane image information and three-dimensional grid information into an initial grid;
continuously deforming the initial grid to approximate the real shape;
and outputting the three-dimensional grid model.
Preferably, the radar acquisition module uses a modulated waveform and directional antenna to transmit electromagnetic energy into a particular region of space to search for targets, targets within the search region will reflect some of the energy back to the radar, and these echoes are then processed by the radar receiver to extract information about the target.
The invention has the technical effects and advantages that: compared with the prior art, the somatosensory shadow particle interactive wall system provided by the invention has the following advantages:
the data acquisition unit is mainly composed of an interactive picture display unit and a data acquisition unit, wherein the data acquisition unit is used for acquiring human body data, the data is displayed through the interactive picture display unit after being processed, the data acquisition unit is mainly composed of a radar acquisition module and a Kinect acquisition module, the motion of a participant is captured by using radar equipment, the captured motion is uploaded to a phase system for analysis, the data obtained by analysis is combined with an interactive system, and an interactive effect is finally generated, so that the participant interacts with a wall surface image, the agility of data acquisition and the efficiency of data processing are improved, and the user experience is improved.
Drawings
FIG. 1 is a block diagram of the system of the present invention;
FIG. 2 is a flow chart of the generation of a planar image according to the present invention;
FIG. 3 is a flow chart of outputting a three-dimensional mesh model according to the present invention;
FIG. 4 is a block diagram of a mesh morphing module of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The specific embodiments described herein are merely illustrative of the invention and do not delimit the invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The invention provides a somatosensory human image particle interactive wall system shown in figures 1-4, which comprises: the interactive picture display unit and the data acquisition unit. The interactive picture display unit consists of a particle system and a model animation which are built in Unity; the data acquisition unit includes: radar collection module and Kinect collection module. The radar acquisition module and the Kinect acquisition module are connected with a program model, and the program model is displayed by combining a particle system with a model animation.
The particle interactive wall displays interactive contents in a mode of combining various software and hardware, and interactive picture display is completed by a VEG (visual effect graph) particle system, a model and animation which are built in Unity. The interaction is accomplished in part by a radar, KinectV2 sensor. The radar is used for acquiring the space coordinates of a plurality of human bodies, the KinectV2 is used for acquiring the posture bone actions of a single human body and the like, and the acquired data are transmitted into the program, and the program completes the display by combining the VEG particle system with model animation through the data.
The radar acquisition module comprises a space human body coordinate acquisition unit and a space human body skeleton acquisition unit.
And radar data acquisition, namely capturing the motion of the participant by using radar equipment, uploading the captured motion to a phase system for analysis, and combining the data obtained by analysis with an interaction system to finally generate an interaction effect so that the participant interacts with the wall image. The radar can enable any developing medium or surface to achieve a multi-point interaction function, such as a wall surface, a ground surface, a desktop surface and an irregular plane object to achieve contact touch, and even non-contact interaction operation can be conducted on a non-plane surface or a water surface. The used techniques are phase conversion and laser ranging.
Radar systems use modulated waveforms and directional antennas to transmit electromagnetic energy into a particular region of space to search for targets. Objects (targets) within the search area reflect some of the energy (radar-transmitted signals or echoes) back to the radar, and these echoes are then processed by the radar receiver to extract information about the target such as distance, velocity, angular position, and other target-identifying features.
The Kinect acquisition module comprises a bone tracking unit, an identity recognition unit and a voice recognition unit. Kinect data acquisition, the Kinect sensor provides three main categories of raw data, depth data stream (depthstream), color video stream (colorstream), raw audio data (rawaudios stream); the method respectively corresponds to three processes of bone tracking (SkeletalTracking), identity recognition (identity) and voice recognition (SpeechPeline). The line-of-sight and skeletal tracking range of Kinect is not very large, being a solid space in the range of several meters in general.
At most, the Kinect can only treat 6 × 25 bone points at the same time, and 6 persons, 25 bone points of each person. When the program is written, each skeletal point of each person is required to be circularly accessed, and each skeletal point has three states, namely tracked state, presumed state and untracked state.
The system also comprises a network module, wherein the network module comprises a remote server, a network and a database, and the remote server is connected with the database through the network.
The data acquisition unit further comprises: the system comprises a feature extraction module and a perception feature module, wherein the feature extraction module and the perception feature module are connected with the radar acquisition module and the Kinect acquisition module.
The interactive picture display unit further comprises a grid deformation module and an initialization grid module, wherein the grid deformation module comprises: the method comprises a sample collecting layer, a first-level deformation layer, a second-level deformation layer and a third-level deformation layer. The interactive picture display unit further comprises: an input plane image module and an output three-dimensional grid model module.
The initialization grid module and the grid deformation module are sequentially connected between the input plane image module and the output three-dimensional grid model module; and the network module is connected with the grid deformation module, and the grid deformation module is connected with the feature extraction module and the perception feature module.
As shown in fig. 2, the method for generating a planar image includes the following steps:
firstly, carrying out model data synchronization on human body coordinate data, spatial human body skeleton data, skeleton tracking data, identity recognition data and voice recognition data;
secondly, performing particle rendering on the synchronized model data;
and thirdly, outputting the plane image.
As shown in fig. 3, when outputting the three-dimensional mesh model, the method includes the following steps:
first, start
Secondly, inputting a plane image;
thirdly, extracting the characteristics of the plane image from the plane image and initializing an elliptical grid;
fourthly, the plane image information is associated with the three-dimensional grid information;
fifthly, inputting the related plane image information and three-dimensional grid information into an initial grid;
sixthly, continuously deforming the initial grid to approximate to a real shape;
seventhly, outputting a three-dimensional grid model;
and eighthly, ending.
The radar acquisition module uses a modulated waveform and directional antenna to transmit electromagnetic energy into a specific area of space to search for targets, targets within the search area will reflect some of the energy back to the radar, and these echoes are then processed by the radar receiver to extract information about the target.
Specifically, when the motion sensing human-image particle interactive wall system is operated, the following steps are referred to:
(1) and radar data acquisition, namely capturing the motion of the participant by using radar equipment, uploading the captured motion to a phase system for analysis, and combining the analyzed data with an interactive system to finally generate an interactive effect so that the participant interacts with the wall surface image. The radar can enable any developing medium or surface to achieve a multi-point interaction function, such as a wall surface, a ground surface, a desktop surface and an irregular plane object to achieve contact touch, and even non-contact interaction operation can be conducted on a non-plane surface or a water surface.
(2) The method comprises the steps that Kinect data are collected, and a Kinect sensor provides three types of original data, namely depth data stream, color video stream and original audio data; respectively corresponding to three processing processes of bone tracking, identity recognition and voice recognition;
(3) data are transmitted into the Unity, and the original model is synchronized according to the corresponding data;
(4) rendering the model begins, adding the VEG particles to the model surface and adding the model animation. The effect of the VEG particles can be further tuned by the particle system.
(5) And synchronizing coordinate information acquired by the radar, and starting to move the model according to the coordinates. The particles will have a ghost tailing effect as the model moves.
(6) And synchronizing the skeleton information collected by the Kinect, binding the skeleton information collected by the Kinect with the model, and synchronizing the human body action.
Be used for gathering human body data through the data acquisition unit, with data processing back, demonstrate through interactive picture show unit, the data acquisition unit mainly has radar collection module and Kinect collection module to constitute, utilize radar equipment to catch participant's action, then reach the phase system analysis on the action of catching, the data that the analysis obtained recombine interactive system, finally produce interactive effect, make participant and wall image carry out the interdynamic, data acquisition's agility and data processing's efficiency has been improved, improve user experience and feel.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments or portions thereof without departing from the spirit and scope of the invention.
Claims (9)
1. The utility model provides a body is felt human shadow particle interactive wall system which characterized in that includes:
the interactive picture display unit and the data acquisition unit are arranged on the mobile terminal;
the interactive picture display unit is composed of a particle system and a model animation which are built in the Unity;
the data acquisition unit includes: the system comprises a radar acquisition module and a Kinect acquisition module;
the radar acquisition module comprises a space human body coordinate acquisition unit and a space human body skeleton acquisition unit;
the Kinect acquisition module comprises a bone tracking unit, an identity recognition unit and a voice recognition unit;
the radar acquisition module and the Kinect acquisition module are both connected with a program model, and the program model is displayed by combining a particle system with a model animation.
2. The somatosensory human-image particle interactive wall system according to claim 1, wherein: the system also comprises a network module, wherein the network module comprises a remote server, a network and a database, and the remote server is connected with the database through the network.
3. The somatosensory human-image particle interactive wall system according to claim 2, characterized in that: the data acquisition unit further comprises: the system comprises a feature extraction module and a perception feature module, wherein the feature extraction module and the perception feature module are connected with the radar acquisition module and the Kinect acquisition module.
4. The somatosensory human-image particle interactive wall system according to claim 3, characterized in that: the interactive picture display unit further comprises a grid deformation module and an initialization grid module, wherein the grid deformation module comprises: the method comprises a sample collecting layer, a first-level deformation layer, a second-level deformation layer and a third-level deformation layer.
5. The somatosensory human-image particle interactive wall system according to claim 4, wherein: the interactive picture display unit further comprises: an input plane image module and an output three-dimensional grid model module.
6. The somatosensory human-image particle interactive wall system according to claim 5, characterized in that: the initialization grid module and the grid deformation module are sequentially connected between the input plane image module and the output three-dimensional grid model module;
and the network module is connected with the grid deformation module, and the grid deformation module is connected with the feature extraction module and the perception feature module.
7. The somatosensory human-image particle interactive wall system according to claim 6, wherein: when the plane image is generated, the method comprises the following steps:
carrying out model data synchronization on human body coordinate data, spatial human body skeleton data, skeleton tracking data, identity recognition data and voice recognition data;
performing particle rendering on the synchronized model data;
and outputting the plane image.
8. The somatosensory portrait particle interactive wall system according to claim 7, wherein: when outputting the three-dimensional mesh model, the method comprises the following steps:
inputting a plane image;
extracting the characteristics of the plane image from the plane image, and initializing an elliptical grid;
associating the planar image information with the three-dimensional mesh information;
inputting the associated plane image information and three-dimensional grid information into an initial grid;
continuously deforming the initial grid to approximate the real shape;
and outputting the three-dimensional grid model.
9. The somatosensory human-image particle interactive wall system according to claim 1, characterized in that: the radar acquisition module uses a modulated waveform and directional antenna to transmit electromagnetic energy into a particular region of space to search for targets, where targets in the search region reflect some of the energy back to the radar, and these echoes are then processed by a radar receiver to extract information about the target.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210553475.8A CN114926573A (en) | 2022-05-20 | 2022-05-20 | Somatosensory shadow particle interactive wall system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210553475.8A CN114926573A (en) | 2022-05-20 | 2022-05-20 | Somatosensory shadow particle interactive wall system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114926573A true CN114926573A (en) | 2022-08-19 |
Family
ID=82810099
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210553475.8A Pending CN114926573A (en) | 2022-05-20 | 2022-05-20 | Somatosensory shadow particle interactive wall system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114926573A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400543A (en) * | 2013-07-18 | 2013-11-20 | 贵州宝森科技有限公司 | 3D (three-dimensional) interactive display system and display method thereof |
| US20140035901A1 (en) * | 2012-07-31 | 2014-02-06 | Microsoft Corporation | Animating objects using the human body |
| KR101723823B1 (en) * | 2016-08-24 | 2017-04-19 | 주식회사 케이쓰리아이 | Interaction Implementation device of Dynamic objects and Virtual objects for Interactive Augmented space experience |
| US20170200313A1 (en) * | 2016-01-07 | 2017-07-13 | Electronics And Telecommunications Research Institute | Apparatus and method for providing projection mapping-based augmented reality |
| CN110458928A (en) * | 2019-08-12 | 2019-11-15 | 苏州悠优互娱文化传媒有限公司 | AR animation producing method, device, medium based on unity3d |
| CN113223056A (en) * | 2021-06-01 | 2021-08-06 | 北京理工大学 | Unmarked motion tracking system based on multiple Kinect V2 |
| CN113741689A (en) * | 2021-08-20 | 2021-12-03 | 苏州创捷传媒展览股份有限公司 | Display system based on Kinect human body contour recognition interaction |
-
2022
- 2022-05-20 CN CN202210553475.8A patent/CN114926573A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140035901A1 (en) * | 2012-07-31 | 2014-02-06 | Microsoft Corporation | Animating objects using the human body |
| CN103400543A (en) * | 2013-07-18 | 2013-11-20 | 贵州宝森科技有限公司 | 3D (three-dimensional) interactive display system and display method thereof |
| US20170200313A1 (en) * | 2016-01-07 | 2017-07-13 | Electronics And Telecommunications Research Institute | Apparatus and method for providing projection mapping-based augmented reality |
| KR101723823B1 (en) * | 2016-08-24 | 2017-04-19 | 주식회사 케이쓰리아이 | Interaction Implementation device of Dynamic objects and Virtual objects for Interactive Augmented space experience |
| CN110458928A (en) * | 2019-08-12 | 2019-11-15 | 苏州悠优互娱文化传媒有限公司 | AR animation producing method, device, medium based on unity3d |
| CN113223056A (en) * | 2021-06-01 | 2021-08-06 | 北京理工大学 | Unmarked motion tracking system based on multiple Kinect V2 |
| CN113741689A (en) * | 2021-08-20 | 2021-12-03 | 苏州创捷传媒展览股份有限公司 | Display system based on Kinect human body contour recognition interaction |
Non-Patent Citations (1)
| Title |
|---|
| 刘佳琪，吴惠明，饶���等: "���达电子战系统射频注入式半实物仿真", 30 September 2016, 北京：中国宇航出版社, pages: 16 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106485779B (en) | A kind of 3D virtual interacting display platform and the method for showing 3D animation | |
| CN103116857B (en) | A kind of virtual show house roaming system controlled based on body sense | |
| Yu et al. | Intelligent visual-IoT-enabled real-time 3D visualization for autonomous crowd management | |
| CN114363689B (en) | Live broadcast control method and device, storage medium and electronic equipment | |
| Dai et al. | Indoor 3D human trajectory reconstruction using surveillance camera videos and point clouds | |
| CN104270577A (en) | Image processing method and device for mobile intelligent terminal | |
| CN115454256A (en) | A digital oath tablet device | |
| Zhuang | Film and television industry cloud exhibition design based on 3D imaging and virtual reality | |
| Chen et al. | Camera networks for healthcare, teleimmersion, and surveillance | |
| Li et al. | Favor: Full-body ar-driven virtual object rearrangement guided by instruction text | |
| CN114926573A (en) | Somatosensory shadow particle interactive wall system | |
| Perales | Human motion analysis and synthesis using computer vision and graphics techniques. State of art and applications | |
| Gahlot et al. | Skeleton based human action recognition using Kinect | |
| Wang et al. | RTMP-ID: Real-Time Through-Wall Multiperson Identification Based on MIMO Radar | |
| Zhao et al. | Implementation of Computer Aided Dance Teaching Integrating Human Model Reconstruction Technology | |
| Park et al. | AR room: Real-time framework of camera location and interaction for augmented reality services | |
| CN114425162B (en) | A video processing method and related device | |
| CN110046936A (en) | Man-machine advertisement exchange method and system based on augmented reality | |
| US20240249419A1 (en) | Information processing apparatus, information processing method, and program | |
| CN117880994A (en) | Wi-Fi (wireless fidelity) perception-based multimode virtual-real fusion method and device | |
| Yang et al. | Synthetic hands generator for RGB hand tracking | |
| Yu et al. | Application of kinect-based motion recognition algorithm in cultural tourism | |
| CN112581572A (en) | Action acquisition method, system, device and computer storage medium | |
| Kister et al. | InHabit: Leveraging Image Foundation Models for Scalable 3D Human Placement | |
| Liu et al. | Research on the acquisition of human behavior data based on Kinect |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220819 |