CN104850383A - Information processing method and electronic equipment - Google Patents
Information processing method and electronic equipment Download PDFInfo
- Publication number
- CN104850383A CN104850383A CN201510281993.9A CN201510281993A CN104850383A CN 104850383 A CN104850383 A CN 104850383A CN 201510281993 A CN201510281993 A CN 201510281993A CN 104850383 A CN104850383 A CN 104850383A
- Authority
- CN
- China
- Prior art keywords
- area
- beholder
- display device
- content
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 16
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 101
- 230000008569 process Effects 0.000 claims description 46
- 230000013011 mating Effects 0.000 claims description 28
- 230000008447 perception Effects 0.000 claims description 27
- 238000003384 imaging method Methods 0.000 claims description 22
- 238000012545 processing Methods 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 21
- 230000000694 effects Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 9
- 238000003860 storage Methods 0.000 description 9
- 239000007767 bonding agent Substances 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 4
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000002310 reflectometry Methods 0.000 description 3
- 238000013519 translation Methods 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 2
- 239000010931 gold Substances 0.000 description 2
- 229910052737 gold Inorganic materials 0.000 description 2
- 230000004308 accommodation Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000037452 priming Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Landscapes
- Processing Or Creating Images (AREA)
Abstract
An embodiment of the invention provides an information processing method and electronic equipment and aims to allow a display device to display contents matching with a virtual image seen by a watcher. The method includes: acquiring an image corresponding to an acquisition range and acquired by an image acquisition device, with a view range of the display device of the electronic equipment matching with the acquisition range; processing the image to obtain processing results which, when the watcher is in the acquisition range, at least include a first area, determined according to the image, corresponding to the virtual image seen by the watcher, and located in the display device, with the virtual image being an image which matches with the point of sight of the watcher, which is watched by the watcher in a mirror reflector overlapping with the display device, and which is symmetrical to the watcher; according to the processing results, controlling the display device to switch to display a second contact matching with the virtual image, from a first content.
Description
Technical field
The present invention relates to electronic technology field, particularly relate to a kind of information processing method and electronic equipment.
Background technology
Mirror face display equipment, as the term suggests, can reflect as mirror exactly and present the virtual image, the content of electronic equipment needs display can be shown again as conventional display device.Just be supplied to a kind of experience newly of beholder so like this, that is exactly beholder while viewing displaying contents, can also watch the virtual image of oneself.
But prior art comprises the electronic equipment of mirror face display equipment, when displaying contents, only consider the display demand of equipment itself.
Summary of the invention
The embodiment of the present application provides a kind of information processing method and electronic equipment, achieves the technique effect that display device shows the displaying contents mated with the virtual image that beholder watches.
On the one hand, this application provides a kind of information processing method, described method comprises:
Obtain the image that image acquisition device is corresponding with acquisition range, wherein, the viewing scope of the display device of electronic equipment is mated with described acquisition range;
Process described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder watch from the specular-reflection unit overlapped with described display device with the picture of the symmetry of described beholder;
According to described result, control described display device and switch to second content of mating with the described virtual image from display first content.
Optionally, process described image to obtain result, comprising:
According to described image, determine the digital viewing person coordinate in first coordinate system corresponding with described beholder, the second coordinate system of described first coordinate system and described acquisition range is symmetrical;
Identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area;
Based on described image, determine described viewpoint;
The coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device;
According to the coordinate of described second area under described three-coordinate, determine described first area.
Optionally, described second content comprises the region instruction of described first area, and the instruction of described region is mated with the described virtual image.
Optionally, control described display device and switch to second content of mating with the described virtual image from display first content, comprising:
The display mode of described first area is adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image; Or
The boundary line of described first area is shown, to strengthen the perception of described beholder to described boundary line with Third Way.
Optionally, after from display, first content switches to second content of mating with the virtual image of described beholder to the described display device of control, described method also comprises:
Show at least one mobile logo on said display means, described mobile logo moves in described first area.
Optionally, according to described result, control described display device and switch to second content of mating with the described virtual image from display first content, comprising:
When described first content comprises at least one object, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches;
At least one object described is adjusted to outside described first area, to obtain described second content, or the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image.
Optionally, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches, comprising:
Determine partly or entirely being arranged in and described first area of at least one object described;
The display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, comprises:
To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
On the other hand, this application provides a kind of electronic equipment, comprising:
Input interface, is connected with treating apparatus and image collecting device, for by the image transmitting corresponding with acquisition range of described image acquisition device to described treating apparatus;
Display device, is connected with described treating apparatus; The viewing scope of described display device is mated with described acquisition range;
Specular-reflection unit, overlaps with described display device;
Described treating apparatus for the treatment of described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder from described specular-reflection unit watch with the picture of the symmetry of described beholder; And according to described result, control described display device and switch to second content of mating with the described virtual image from display first content.
Optionally, described electronic equipment also comprises:
Touch-control input device, overlaps with described display device and described specular-reflection unit, for detecting touch-control input.
Optionally, described specular-reflection unit overlaps on described display device first surface toward the outside, and described touch-control input device is arranged on described specular-reflection unit toward the outside second; Or
Described touch-control input device overlaps on described display device first surface toward the outside, and described specular-reflection unit overlaps on described touch-control input device toward the outside the 3rd.
Optionally, described specular-reflection unit is the specular layer of described display device, and described touch-control input device overlaps on described display device first surface toward the outside.
Optionally, described image collecting device is arranged on the primary importance of described display device, to make the imaging plane of described image collecting device parallel with the imaging plane of described display device or coplanar.
Optionally, described electronic equipment also comprises:
Voice collection device, is connected with described treating apparatus, for gathering the sound of described beholder;
Described treating apparatus is analyzed described sound, determines the steering order that described sound is corresponding; Perform the steering order of described correspondence.
Optionally, described treating apparatus is used for according to described image, determines the digital viewing person coordinate in first coordinate system corresponding with described beholder, and the second coordinate system of described first coordinate system and described acquisition range is symmetrical; Identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area; Based on described image, determine described viewpoint; The coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device; According to the coordinate of described second area under described three-coordinate, determine described first area.
Optionally, described second content comprises the region instruction of described first area, and the instruction of described region is mated with the described virtual image.
Optionally, described treating apparatus is used for the display mode of described first area being adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image; Or treating apparatus to show the boundary line of described first area with Third Way for controlling display device, show the part within described boundary line, to strengthen the perception of described beholder to described boundary line with the fourth way being different from described Third Way.
Optionally, described display device is also for after controlling described display device first content switching to second content of mating with the virtual image of described beholder from display at described treating apparatus, show at least one mobile logo, described mobile logo moves in described first area.
Optionally, described treating apparatus is used for comprising at least one object when described first content, according to described first area, determines that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches; At least one object described is adjusted to outside described first area, to obtain described second content, or the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image;
Described display device is for showing described second content.
Optionally, described treating apparatus is for determining partly or entirely being arranged in and described first area of at least one object described; To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
Above-mentioned one or more technical scheme in the embodiment of the present application, at least has one or more technique effects following:
In the technical scheme of the application, obtain the image that image acquisition device is corresponding with acquisition range, wherein, the viewing scope of the display device of electronic equipment is mated with described acquisition range; Process described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder watch from the specular-reflection unit overlapped with described display device with the picture of the symmetry of described beholder; According to described result, control described display device and switch to second content of mating with the described virtual image from display first content.So the electronic equipment in the embodiment of the present application by processing the image of image acquisition device, thus obtains the result comprised according to first area, and first area is corresponding with the virtual image, and region on the display apparatus.And then, when controlling display device and showing, just first content can be switched to second content of mating with the virtual image according to result.Therefore, when electronic equipment controls display, not only can consider the display demand of itself, also contemplate the impact of the virtual image, thus achieve the technique effect making beholder watch the displaying contents mated with the virtual image.
Accompanying drawing explanation
Fig. 1 is the electronic devices structure schematic diagram in the embodiment of the present application;
Fig. 2 is the information processing method process flow diagram in the embodiment of the present application;
Fig. 3 a-Fig. 3 b is the first coordinate system, the second coordinate system and three-coordinate schematic diagram in the embodiment of the present application;
Fig. 4 is the first coordinate system in the embodiment of the present application and three-coordinate transformational relation schematic diagram;
Fig. 5 a is the schematic diagram in the mobile logo T1 moment in the embodiment of the present application;
Fig. 5 b is the schematic diagram in the mobile logo T2 moment in the embodiment of the present application;
Fig. 5 c is the schematic diagram in the mobile logo T3 moment in the embodiment of the present application;
Fig. 6 a is the first content schematic diagram in the embodiment of the present application;
Fig. 6 b is the virtual image schematic diagram that first content in the embodiment of the present application and beholder watch;
Fig. 6 c is the virtual image schematic diagram that one second content in the embodiment of the present application and beholder watch;
Fig. 6 d is the virtual image schematic diagram that another second content in the embodiment of the present application and beholder watch;
Fig. 7 a-Fig. 7 c be in the embodiment of the present application display device, specular-reflection unit and touch-control input device schematic diagram is set.
Embodiment
The embodiment of the present application provides a kind of information processing method and electronic equipment, achieves the technique effect that display device shows the displaying contents mated with the virtual image that beholder watches.
The technical scheme general thought that the application provides is as follows:
In the technical scheme of the application, obtain the image that image acquisition device is corresponding with acquisition range, wherein, the viewing scope of the display device of electronic equipment is mated with described acquisition range; Process described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder watch from the specular-reflection unit overlapped with described display device with the picture of the symmetry of described beholder; According to described result, control described display device and switch to second content of mating with the described virtual image from display first content.So the electronic equipment in the embodiment of the present application by processing the image of image acquisition device, thus obtains the result comprised according to first area, and first area is corresponding with the virtual image, and region on the display apparatus.And then, when controlling display device and showing, just first content can be switched to second content of mating with the virtual image according to result.Therefore, when electronic equipment controls display, not only can consider the display demand of itself, also contemplate the impact of the virtual image, thus achieve the technique effect making beholder watch the displaying contents mated with the virtual image.
Below by accompanying drawing and specific embodiment, technical solution of the present invention is described in detail, the specific features being to be understood that in the embodiment of the present application and embodiment is the detailed description to technical scheme, instead of the restriction to technical scheme, when not conflicting, the technical characteristic in the embodiment of the present application and embodiment can combine mutually.
Term "and/or" herein, being only a kind of incidence relation describing affiliated partner, can there are three kinds of relations in expression, and such as, A and/or B, can represent: individualism A, exists A and B simultaneously, these three kinds of situations of individualism B.In addition, character "/" herein, general expression forward-backward correlation is to the relation liking a kind of "or".
The embodiment of the present application first aspect provides a kind of information processing method.Please refer to Fig. 1, for the one being applicable to information processing method in the present embodiment may electronic devices structure schematic diagram.This electronic equipment comprises: input interface 101, treating apparatus 102, display device 103 and specular-reflection unit 104.Optionally, electronic equipment can also comprise image collecting device 105.
Wherein, input interface 101 is connected with treating apparatus 102 and image collecting device 105.Image collecting device 105 in the embodiment of the present application can be that 3D is (three-dimensional, three-dimension) video camera, depth camera, binocular camera, also can be the device that two common camera etc. can obtain the degree of depth in acquisition range, secondary the application is not limited.According to the image that image collecting device 105 gathers, the degree of depth of acquisition range can be obtained.
When image collecting device 105 is the image collecting device of electronic equipment self, input interface 101 can be built-in interface; When image collecting device 105 is external image collecting device, input interface 101 can for being exposed to outer interface, and the application does not do concrete restriction.Input interface 101 for the image transmitting corresponding with acquisition range that image collecting device 105 is gathered to treating apparatus 102.
Display device 103 is connected with treating apparatus 102, for showing according to the control for the treatment of apparatus 102.In the embodiment of the present application, the viewing scope of display device 103 is mated with acquisition range.Such as acquisition range is consistent with viewing scope, and acquisition range is within viewing scope, or acquisition range is greater than and comprises viewing scope etc.
Electronic equipment in the embodiment of the present application also comprises specular-reflection unit 104.Specifically, specular-reflection unit 104 is light-permeable and can presents the device of mirror effect.Specifically, specular-reflection unit 104 overlaps in display device 103, specular-reflection unit 104 is pointing on the direction of mirror face display equipment 104 from display device 103, transmissivity is higher than first threshold, with the display making specular-reflection unit 104 not affect display device 103, beholder still can see through specular-reflection unit 104 content that display device 103 shows.First threshold is as 80%, 95% etc.Meanwhile, specular-reflection unit 104 toward the outside, namely towards the reflectivity of the side of beholder higher than Second Threshold, to make more extraneous light be reflected after arrival specular-reflection unit 104, thus enable beholder watch the virtual image.Second Threshold is as 60%, 55% etc.
Specular-reflection unit 104 can independent of display device 103, and the mode of being fixed by bonding agent or machinery is overlapped in display device 103.Or when display device 103 at least comprises display layer and specular layer, specular layer also can directly as specular-reflection unit 104.Wherein specular layer is the skin of display device 103, and projection ratio is higher than first threshold, when reflectivity is higher than Second Threshold.The those of ordinary skill in field described in the application also can be arranged according to actual, and the application does not do concrete restriction.
Because specular-reflection unit 104 reflectivity in the embodiment of the present application is higher, itself has mirror effect, no matter whether display device 103 powers on, whether be in display state, specular-reflection unit 104 relies on own physical character, can present the virtual image in specular-reflection unit 104 objects in front, beholder or space.Specular-reflection unit 104 objects in front, beholder or space are symmetrical with the respective virtual image about specular-reflection unit 104.
Below the information processing method in the present embodiment is introduced.Please refer to Fig. 2, the method comprises:
S101: obtain the image that image acquisition device is corresponding with acquisition range.
S102: process described image to obtain result.
S103: according to described result, controls described display device and switches to second content of mating with the described virtual image from display first content.
First, obtain image collecting device 105 and gather the image corresponding with acquisition range.Image in the embodiment of the present application is depth image, namely can be obtained the degree of depth of each point in image by image.Then, treating apparatus 102 processes image in S103, thus obtains result.Wherein, when there is beholder in acquisition range, result at least comprises the first area determined according to image.Wherein first area is specially corresponding with the virtual image of beholder, and the region in display device 103.Such as first area is the region that display device 103 overlaps with the virtual image, or first area is display device is greater than and comprises the region etc. of the virtual image.
Although the virtual image of beholder and beholder are etc. large and symmetry, when the viewpoint of beholder, sight line or eye locations change, the virtual image finally watched also can change.Therefore, the embodiment of the present application virtual image is hereinafter specially the virtual image of mating with beholder's viewpoint, i.e. the actual virtual image watched in specular-reflection unit 104 of beholder.
In addition, in specific implementation process, result can also include but not limited to the degree of depth, gray scale etc. of viewpoint, every bit.
Finally, in S103, treating apparatus 102, according to result, controls display device 103 and switches to second content of mating with the virtual image from display first content.Such as will on the display apparatus, switching Show Color in the region that beholder watches the virtual image is black, or switches to non-display state etc.
Seen from the above description, the electronic equipment in the embodiment of the present application by processing the image of image acquisition device, thus obtains the result comprised according to first area, and first area is corresponding with the virtual image, and region on the display apparatus.And then, when controlling display device and showing, just first content can be switched to second content of mating with the virtual image according to result.Therefore, when electronic equipment controls display, not only can consider the display demand of itself, also contemplate the impact of the virtual image, thus achieve the technique effect making beholder watch the displaying contents mated with the virtual image.
Below the detailed process processing image in S102 is introduced.In the embodiment of the present application, S102 comprises:
(1) according to described image, determine the digital viewing person coordinate in first coordinate system corresponding with described beholder, the second coordinate system of described first coordinate system and described acquisition range is symmetrical;
(2) identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area;
(3) based on described image, described viewpoint is determined;
(4) coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device;
(5) according to the coordinate of described second area under described three-coordinate, described first area is determined.
Conveniently the process of process image is introduced, first the relation between the first coordinate system in the embodiment of the present application, the second coordinate system, three-coordinate and above-mentioned three coordinate systems and conversion is described.
In order to aspect illustrates, suppose that image collecting device 105 is arranged on display device 103 and specular-reflection unit 104 position as shown in Figure 1.Suppose the imaging plane of display device 103, the plane of reflection of specular-reflection unit 104, and the imaging plane of image collecting device 105 is coplanar simultaneously.As shown in Figure 3 a and Figure 3 b shows, the second coordinate system xyz is the three-dimensional system of coordinate of acquisition range, and in acquisition range, the locus of each point can be represented by the coordinate under the second coordinate system.And the locus of each point can be represented by the coordinate under the first coordinate system x ' y ' z ' in the virtual image scope that specular-reflection unit 104 presents.Virtual image scope is the virtual image of acquisition range.Acquisition range is a three dimensions, and therefore virtual image scope is also a three dimensions.First coordinate system x ' y ' z ' and the second coordinate system xyz are about xOy plane symmetry.As shown in Figure 3 b, if the O of above-mentioned two coordinate systems is at the center of display device 103, and the y-axis of two coordinate systems and y ' axle are vertical ground upwards, and x-axis and x ' axle are abreast towards the right side.And the imaging plane that the z-axis of the second coordinate system is vertical display device 103 points to acquisition range, the z ' axle of the first coordinate system is imaging plane sensing display device 103 outside of vertical display device 103.
Three-coordinate x ' y ' is two-dimensional coordinate system, for representing the planimetric position of every bit in display device 103, in other words, on the imaging plane of display device 103 and the plane of reflection of specular-reflection unit 104, the position of every bit can be showed by the coordinate under three-coordinate x ' y '.
First the conversion between the first coordinate system and the second coordinate system and relation is introduced.
Due to the imaging plane of image collecting device 105 and the imaging plane of display device 103 coplanar, so the imaging plane of same some range image harvester 105 in acquisition range is identical with the imaging plane of display device 103.Coordinate so under the first coordinate system x ' y ' z ' and the coordinate under the second coordinate system xyz, x-axis is identical with the value of x ' axle, and y-axis is identical with the value of y ' axle, and the value of z-axis and z ' axle is contrary.In other words, by certain some the coordinate z-axis under the second coordinate system value get opposite number and just can change and obtain the coordinate of this virtual image under the first coordinate system.As shown in Figure 3 a, the circle of solid line represents beholder, and the circle of short-term pecked line represents the virtual image with beholder's symmetry.Such as when certain o'clock of beholder is when the coordinate of the second coordinate system is (12,5,2), so the coordinate of the virtual image of this point under the first coordinate system is just (12,5 ,-2).
Further, due to can be obtained by image collecting device 105 each point in acquisition range the degree of depth and in the horizontal and vertical directions with the distance of image collecting device 105, and then just can obtain each some coordinate under the first coordinate system xyz in acquisition range.Further the value of each some z-axis is got opposite number, electronic equipment just can set up one consistent with virtual scope, and with the digital space of acquisition range symmetry.So, the coordinate under the first coordinate system x ' y ' z ', while the locus of expression point in virtual image scope, can also represent the locus of same point in digital space.
In the embodiment of the present application, when beholder is in acquisition range, electronic equipment can set up digital space according to each point in image, and the digital viewing person corresponding with beholder is in digital space.Or electronic equipment also can not set up digital space, by the coordinate of above-mentioned embodiment determination digital viewing person under the first coordinate system x ' y ' z ', to obtain the locus of the virtual image in virtual image scope of beholder.The those of ordinary skill in field described in the application can be arranged according to actual, and the application does not do concrete restriction.
Next the conversion between the first coordinate system and three-coordinate and relation is introduced.
The virtual image watched due to beholder is relevant with viewpoint, therefore, after certain puts the coordinate in the first coordinate system in acquisition, also need to determine that the virtual image that beholder's viewpoint is watched finally is mapped to the position of the plane of reflection of specular-reflection unit 104, the coordinate figure namely under three-coordinate.
As shown in Figure 4, the viewpoint of beholder is regarded as a video camera, suppose that viewpoint is E point, A ' B ' C ' D ' is human eye imaging plane, and the 4-coordinate of human eye is x
ey
ez
e.First coordinate of the application is tied to the transfer process of three-coordinate for convenience of description, illustrates for the X point in virtual image space at this.The coordinate figure of X point under the first coordinate system is X (x, y, z).The coordinate figure of viewpoint under the first coordinate system is E (x
e, y
e, z
e), the coordinate of center under the first coordinate system of display device 103 is O (x
o, y
o, z
o).Suppose the center of the sight line of beholder towards display device 103, i.e. z
epoint to O point, so 4-coordinate system x
ey
ez
ez
ethe vector representation of axle under the first coordinate system is
suppose that ABCD is perpendicular to ground, and be y with gravity direction
ethe direction of axle, therefore y
ethe vector representation of axle under the first coordinate system is r
y=(0 ,-1,0).X can be determined according to right-hand rule
evector representation under the first coordinate system is r
x=r
y× r
z.Further, in order to ensure x
ey
ez
estrict orthogonal, to r
ydo following correction, r
y'=r
z× r
x.Further, respectively to r
x, r
y', r
zbe normalized operation, obtain
r simultaneously
1, r
2, r
3vectorial e can be expressed as respectively under 4-coordinate system
x=(1,0,0), e
y=(0,1,0), e
z=(0,0,1).
Just can be parallel with 4-coordinate system if the first coordinate system rotates through one, i.e. x
eparallel with x ', y
eparallel with y ', z
eparallel with z '.So set rotation matrix as Re, have Rer
1=e
x, Rer
2=e
y, Rer
3=e
z, and then obtain rotation matrix Re=[r
1r
2r
3]-1=[r
e1r
e2r
e3].
Further, parallel with 4-coordinate system owing to rotating rear first coordinate system, if again through translation, the first coordinate system and 4-coordinate system just can be made to overlap, thus just can by the first ordinate transform to 4-coordinate system.
Because the coordinate of viewpoint E under 4-coordinate system is (0,0,0), can obtain
For the column vector expression-form of an E under the first coordinate system.Thus calculate the translation vector that the first coordinate is tied to 4-coordinate system and be
And then be [Re te]=[r according to the external parameter that Re and te just can obtain viewpoint
e1r
e2r
e3te].
Further, the inner parameter matrix A e of viewpoint easily obtains, and X point is set to m point in the imaging of eyes imaging plane A ' B ' C ' D ', and the coordinate under 4-coordinate system is m (u, v, 1), then establishes λ
1for X point is to the vertical range of A ' B ' C ' D ', acquisition can be calculated
Namely
(formula 1).Establish the line of X point and viewpoint E and ABCD in x point again, the coordinate figure of x point under the first coordinate system is x (x ', y ', z '), and x point is at beholder's viewpoint actual virtual image X watched on specular-reflection unit 104.Be similar to formula 1, can obtain
(formula 2), λ
2for x point is to the vertical range of A ' B ' C ' D '.
Because three-coordinate is two-dimensional coordinate system, i.e. x (x ', y ', z ')=x (x ', y '), so above-mentioned formula 2 just can be simplified to
Wherein, He is exactly the homography matrix of ABCD to A ' B ' C ' D '.
Finally, formula (1) and formula (2) Simultaneous Equations can be obtained
(formula 3).λ=λ
1/λ
2。
Last electronic equipment can determine the position of virtual image X on the plane of reflection of specular-reflection unit 104 by formula 3, i.e. the coordinate figure of x under three-coordinate.
In specific implementation process, electronic equipment prestores formula 3, the virtual image of one or more impact point in the acquisition range needing to determine that beholder watches in specular-reflection unit 104, when also namely determining the position of the virtual image of impact point in display device 103, from image, obtain viewpoint, the degree of depth of impact point, vertical and the horizontal range of distance specular-reflection unit 104, by degree of depth negate, the x in formula 3 just can be obtained, y and z.Can external parameter by viewpoint, and then the position of the virtual image that just can obtain the impact point that beholder watches in display device 103 or region.
In conjunction with foregoing description, next the process of S102 is introduced.
First electronic equipment is analyzed image in step (1), obtains the coordinate of beholder in the second coordinate system, and obtains the coordinate of digital viewing person in the first coordinate system further.Then, in step (2), electronic equipment identifies digital beholder, obtains the second area of digital viewing person.In the embodiment of the present application, step (2) specifically identifies in conjunction with the degree of depth of beholder and the profile of colouring information to digital beholder.Second area comprises the part within the boundary line of profile and boundary line.After identifying second area, the coordinate of second area under the first coordinate system can be determined.
In addition, in step (3), the viewpoint of beholder can also be determined to the analysis of image.The viewpoint obtaining beholder can use the skeleton data extracting method of Kinect SDK from image, to obtain the number of people position of beholder, using number of people position as viewpoint.Can also use three-dimensional face modeling, position of human eye extracts as viewpoint by ground.
In specific implementation process, step (3) can perform before step (1) and step (2), and can perform after step (1) and step (2), the application does not do concrete restriction yet.
Last in step (4), to viewpoint and second area, the coordinate under the first coordinate system performs the calculating in formula 3, just can obtain the coordinate of first area under three-coordinate that second area is corresponding, thus just can determine first area in step (5).
By said process, electronic equipment just defines the first area of the virtual image coupling in display device 103 that beholder's viewpoint watches.In the embodiment of the present application, first area comprises the part within the boundary line of first area and boundary line.
After obtaining result, perform S103.In the embodiment of the present application, S103 has numerous embodiments, below enumerates wherein several, in specific implementation process, includes but not limited to following example.
The first:
Second content comprises the region instruction of first area, and the instruction of described region is mated with the virtual image.
Specifically, in the embodiment of the present application, region instruction can have multiple indicating mode, enumerate below wherein two kinds be described.
Mode 11, the display mode of described first area is adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image.
Specifically, in the embodiment of the present application, first content comprises the first area shown in the first way.In a first mode, beholder is not strong to the virtual image perception on specular-reflection unit 104, clearly can not watch the virtual image of oneself.For example, suppose that first method is specially the brightness display first area with 95%, beholder time display brightness is high, can be caused not see the virtual image; With yellow display first area, or with multiple color, as red, green, blue and the yellow different piece showing first area, such Show Color also can cause beholder not see the virtual image.
Therefore first content is switched to the second content, the display mode by first area is adjusted to the second method being different from first method from first method, to strengthen the perception of beholder to the virtual image.
For example, suppose that first method is the brightness display first area with 95%, so second method is with the brightness display first area being less than 95%, as 20%, and 30% etc.Because brightness reduces, first area just decreases through the light of specular-reflection unit 104, and then beholder more clearly can perceive the virtual image.
Again for example, when first method is that second method is with black display first area with yellow display first area.Because first area is shown as black, the light of the light therethrough specular-reflection unit 104 that first area sends is less than yellow, and being conducive to beholder more clearly can perceive the virtual image.
Or first method is with multiple color, during different piece as red, green, blue and yellow display first area, second method is less than with the L value of Lab the different piece that red, green, blue and 4 kinds of yellow colors show first areas.In other words, red, green, blue and yellow L value are turned down.Because the L value of Show Color have dropped, the brightness of first area entirety just reduces, thus beholder more clearly can perceive the virtual image.
Mode 12: the boundary line showing described first area with Third Way, to strengthen the perception of described beholder to described boundary line.
In the embodiment of the present application, with the boundary line of Third Way display first area, such as with the boundary line of gold display first area, with the boundary line of the dotted line of loopy moving display first area, or with color of boundary line, very first time interval replacing first area etc., thus enable beholder perceive the boundary line of first area more consumingly.The application those of ordinary skill in the field can be arranged according to actual, and the application does not do concrete restriction.
Optionally, in order to the boundary line of more outstanding first area, the part within boundary line, first area can also adopt the fourth way display being different from Third Way.Such as with the boundary line of gold display first area, with the part within boundary line, black display first area; With the boundary line of the dotted line of loopy moving display first area, with the part within many parallel diagonal lines display boundary lines, first area; Or with the color of boundary line, very first time interval replacing first area, but the part controlled within boundary line, first area is in non-display state etc.The application those of ordinary skill in the field can be arranged according to actual, and the application does not do concrete restriction.
Further, no matter carry out region instruction in which way, after display second content, can also comprise:
Show at least one mobile logo on said display means, described mobile logo moves in described first area.
Specifically, in the embodiment of the present application, at least one mobile logo can be 1, and 3 or 5 etc., concrete restriction is not done in the volume cost application for mobile logo.Mobile logo can move, and in the embodiment of the present application, mobile logo moves in first area.In other words, the maximum magnitude of mobile logo movement does not exceed the boundary line of first area.
In specific implementation process, mobile logo can be straight line, circle or other marks, and the application does not do concrete restriction.Further, mobile logo is in moving process, and in order to ensure that moving range is in first area, treating apparatus 102 can carry out accommodation to mobile logo.Such as mobile logo is straight line, so treating apparatus 102 can according to mobile logo current position adjustment straight length, or mobile logo is circle, so treating apparatus 102 can adjust circle radius, to make the moving range of mobile logo in first area according to the current position of mobile logo.
For example, suppose that at least one mobile logo is specially two straight lines, as shown in Figure 5 a, move to first area central vertical from the position shown in Fig. 5 a at T1 moment two straight lines simultaneously.Move the position shown in Fig. 5 b in the T2 moment, and when Fig. 5 b position, the length of two straight lines is adjusted compared with the length in Fig. 5 a by treating apparatus 102, thus two straight lines all move in first area.Overlap in the position of T3 moment two straight lines shown in Fig. 5 c.After the T3 moment, two straight lines are separated, and to the vertically movement of the direction away from center, first area, until again move to center after arriving position, boundary line, first area, repeat said process.
The second:
When first content comprises at least one object, according to first area, determine that at least one object of first content is located in first area corresponding to the virtual image that beholder watches.
Specifically, in the embodiment of the present application, at least one object can be 1,2 or 4 etc., and when at least one object be two and two or more object time, two and two or more object can be the same or different, and the application does not limit this.
For example, please refer to Fig. 6 a, is the first content schematic diagram of display in display device 103.Suppose that at least one object is specially word " Text Information " and a pictures picture.Beholder stands in display device 103 front, watches the virtual image of oneself.Please refer to Fig. 6 b, is the schematic diagram of the virtual image that first content and beholder watch.Owing to watching the corresponding region of the virtual image beholder, namely show at least one object in first area, therefore cause beholder not see the virtual image of oneself.
Now, switch at the second in the mode of first content to the second content, multiple switching mode can be comprised again, below will enumerate two kinds.
Mode 21, at least one object described is adjusted to outside described first area, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image.
Specifically, in order to strengthen the perception of beholder to the virtual image, at least one object can be adjusted to outside first area thus to obtain the second content.In specific implementation process, when determining that at least one object is presented at first area content, the coordinate of at least one object under three-coordinate revised by electronic equipment, makes the coordinate of at least one object not in first area, and then obtain the second content.So, when display the second content, please refer to Fig. 6 c, it is the schematic diagram of the virtual image that the second content and beholder watch, because at least one object does not show in first area, thus the virtual image that beholder is seen is more clear, enhances the perception of beholder to the virtual image.
Mode 22, the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthens the perception of described beholder to the described virtual image.
Specifically, in order to strengthen the perception of beholder to the virtual image, the display mode of at least one object can be adjusted to the 6th mode from the 5th mode.In the embodiment of the present application, the 5th mode for show at least one object with one or more priming colors, as with yellow display word " Text Information ", can show image sheet picture with the pixel value of each pixel.6th mode can be with at least one object of black display, or at least one object is adjusted to non-display state.
Optionally, in the embodiment of the present application, when the display mode of at least one object is adjusted to the 6th mode from the 5th mode, only can adjust and be arranged in the part or all of of first area, and not need the part be positioned at beyond first area to be also adjusted to the 6th mode and show.
Specifically, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches, comprising:
Determine partly or entirely being arranged in and described first area of at least one object described;
The display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, comprises:
To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
Specifically, please refer to Fig. 6 d.Electronic equipment, according to first area and the coordinate of at least one object under three-coordinate, determines that at least one object is positioned in the first region part or all of.Then, the part or all of display mode being arranged in first area is adjusted to the 6th mode.For example, the word and Picture section that are positioned at first area in Fig. 6 b can be adjusted to black.Finally show as the second content in Fig. 6 d in display device 103.Because at least one object is positioned at the part or all of with black display of first area, and then the brightness of first area entirety just reduces, thus beholder more clearly can perceive the virtual image.
The application's second aspect provides a kind of electronic equipment, as shown in Figure 1, comprising:
Input interface 101, is connected with treating apparatus 102 and image collecting device 105, for the image transmitting corresponding with acquisition range that gathered by described image collecting device 105 to described treating apparatus 102;
Display device 103, is connected with described treating apparatus 102; The viewing scope of described display device 103 is mated with described acquisition range;
Specular-reflection unit 104, overlaps with described display device 103;
Described treating apparatus 102 for the treatment of described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and the first area in described display device 103; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder from described specular-reflection unit 104 watch with the picture of the symmetry of described beholder; And according to described result, control described display device 103 and switch to second content of mating with the described virtual image from display first content.
The embodiment of above-mentioned input interface 101, treating apparatus 102, display device 103, specular-reflection unit 104 and image collecting device 105 is existing in the preceding article to be introduced, and just it is no longer repeated here.
Optionally, the electronic equipment in the embodiment of the present application can further include touch-control input device 106, for detecting touch-control input.Touch-control input device 106 in the embodiment of the present application is a transparent Trackpad, is overlapped by the mode of bonding agent or mechanical connection and display device 103 and specular-reflection unit 104.Specifically, touch-control input device 106 points to transmissivity on the direction of touch-control input device 106 higher than the 3rd threshold value in display device 103, with the display making touch-control input device 106 not affect display device 103, beholder still can see through touch-control input device 106 content that display device 103 shows.Second Threshold is as 80%, 95% etc., and in specific implementation process, the 3rd threshold value and Second Threshold can be the same or different.The those of ordinary skill in field described in the application can be arranged according to actual, and the application does not do concrete restriction.
Specifically, in the embodiment of the present application, touch-control input device 106 overlaps mode with display device 103 and specular-reflection unit 104 to be had multiple, below will enumerate wherein several.
The first:
Specular-reflection unit 104 is independent with display device 103.Display device at least comprises first surface, and first surface is the side toward the outside.Specifically, as shown in Figure 7a, when the content of display device 103 display is watched in position to beholder in figure 7 a, specular-reflection unit 104 and the spacing of beholder, be slightly less than the spacing of display device 103 and beholder.Specular-reflection unit 104 is relevant with the thickness of specular-reflection unit 104 with Distance geometry display device between beholder 103 and the difference of the spacing of beholder.
Touch-control input device 106 in the embodiment of the present application is a transparent Trackpad, is overlapped on specular-reflection unit 104 toward the outside second by the mode of bonding agent or mechanical connection.Specifically, as shown in Figure 7a, when the content of display device 103 display is watched in position to beholder in figure 7 a, the spacing of specular-reflection unit 104 and beholder, slightly larger than the spacing of touch-control input device 106 with beholder.Specular-reflection unit 104 is relevant with the thickness of touch-control input device 106 with Distance geometry touch-control input device between beholder 106 and the difference of the spacing of beholder.
Because touch-control input device 106 is transparent, therefore overlap on second of specular-reflection unit 104, beholder still can watch the virtual image in specular-reflection unit 104, and the content that display device 103 shows.Touch-control input can also be carried out on touch-control input device 106 simultaneously.
The second:
Specular-reflection unit 104 is independent with display device 103.Display device 103 at least comprises first surface, and first surface is the side toward the outside.Touch-control input device 106 in the embodiment of the present application is a transparent Trackpad, overlaps on the first surface of display device 103 by the mode of bonding agent or mechanical connection.Specifically, as shown in Figure 7b, when the content of display device 103 display is watched in position to beholder in fig .7b, touch-control input device 106 and the spacing of beholder, be slightly less than the spacing of display device 103 and beholder.Touch-control input device 106 is relevant with the thickness of touch-control input device 106 with the difference of the spacing of beholder with display device 103 with the spacing of beholder.
Specular-reflection unit 104 in the embodiment of the present application is overlapped on touch-control input device 106 toward the outside the 3rd by the mode of bonding agent or mechanical connection.Specifically, as shown in Figure 7b, when the content of display device 103 display is watched in position to beholder in fig .7b, specular-reflection unit 104 and the spacing of beholder, be slightly less than the spacing of touch-control input device 106 and beholder.Specular-reflection unit 104 is relevant with the thickness of specular-reflection unit 104 with Distance geometry touch-control input device between beholder 106 and the difference of the spacing of beholder.
Due to touch-control input device 106 and specular-reflection unit 104 transparent, therefore overlap in display device 103, beholder still can watch the virtual image in specular-reflection unit 104, and display device 103 show content.Meanwhile, specular-reflection unit 104 can also play a protective role to touch-control input device 106.
The third:
Display device 103 at least comprises display layer and specular layer.Display layer needs the content of display by luminescence display, and specular layer is arranged on display layer, as shown in Figure 7 c.When display device 103 is watched in beholder position in figure 7 c, specular layer is more close to beholder.Specular layer is transparent, and then the light that display layer is sent can enter beholder's eyes through specular layer.
Touch-control input device 106 in the embodiment of the present application is a transparent Trackpad, is overlapped on display device 103 first surface toward the outside by the mode of bonding agent or mechanical connection.Specifically, as shown in Figure 7 c, when the content of display device 103 display is watched in position to beholder in figure 7 c, the spacing of specular layer and beholder, slightly larger than the spacing of touch-control input device 106 with beholder.The spacing of specular layer and beholder, slightly larger than the distance between display layer and beholder.
Because touch-control input device 106 is transparent, therefore overlap on the first surface of display device 103, beholder still can watch the virtual image in specular layer, and the content of display layer display.
Optionally, in the embodiment of the present application, in any case arrange touch-control input device 106 and specular-reflection unit 104, image collecting device 105 is all arranged on the primary importance of display device 103.Specifically, primary importance as shown in Figure 1, can be positioned at the centre of display device 103 first side.Now, the imaging plane of image collecting device 105 is parallel with the imaging plane of display device 103 or coplanar.Or, image collecting device 105 is arranged on relative second side, first side, or setting is that other are local, as long as make the imaging plane of image collecting device 105 parallel with the imaging plane of display device 103 or coplanar.When the imaging plane of image collecting device 105 is parallel with the imaging plane of display device 103, obtain the coordinate time of first area under three-coordinate, adaptability revision translation vector.
Optionally, electronic equipment can also comprise voice collection device, is connected with treating apparatus 102.Voice collection device can gather the sound of beholder, and the sound of collection is sent to treating apparatus 102.After treating apparatus 102 receives sound, sound source is analyzed, and contrast with the steering order in sound instruction storehouse, and then determine the steering order corresponding to sound.After determining corresponding steering order, perform corresponding steering order.
Further, in the embodiment of the present application, treating apparatus 102, for according to described image, determines the digital viewing person coordinate in first coordinate system corresponding with described beholder, and the second coordinate system of described first coordinate system and described acquisition range is symmetrical; Identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area; Based on described image, determine described viewpoint; The coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device 103; According to the coordinate of described second area under described three-coordinate, determine described first area.
Specifically, in the embodiment of the present application, described second content comprises the region instruction of described first area, and the instruction of described region is mated with the described virtual image.
Further, described treating apparatus 102 for the display mode of described first area to be adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image; Or treating apparatus 102 to show the boundary line of described first area with Third Way for controlling display device 103, the part within described boundary line is shown, to strengthen the perception of described beholder to described boundary line with the fourth way being different from described Third Way.
Further, described display device 103 is also for after controlling described display device first content switching to second content of mating with the virtual image of described beholder from display at described treating apparatus 102, show at least one mobile logo, described mobile logo moves in described first area.
Or, described treating apparatus 102 is for comprising at least one object when described first content, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches; At least one object described is adjusted to outside described first area, to obtain described second content, or the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image;
Described display device 103 is for showing described second content.
Further, described treating apparatus 102 is for determining partly or entirely being arranged in and described first area of at least one object described; To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
The various variation pattern of the information processing method described in previous embodiment and instantiation are equally applicable to the electronic equipment of the present embodiment, by the aforementioned detailed description to information processing method implementation, those skilled in the art clearly can know the implementation method of electronic equipment in the present embodiment, so succinct in order to instructions, be not described in detail in this.
Above-mentioned one or more technical scheme in the embodiment of the present application, at least has one or more technique effects following:
In the technical scheme of the application, obtain the image that image acquisition device is corresponding with acquisition range, wherein, the viewing scope of the display device of electronic equipment is mated with described acquisition range; Process described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder watch from the specular-reflection unit overlapped with described display device with the picture of the symmetry of described beholder; According to described result, control described display device and switch to second content of mating with the described virtual image from display first content.So the electronic equipment in the embodiment of the present application by processing the image of image acquisition device, thus obtains the result comprised according to first area, and first area is corresponding with the virtual image, and region on the display apparatus.And then, when controlling display device and showing, just first content can be switched to second content of mating with the virtual image according to result.Therefore, when electronic equipment controls display, not only can consider the display demand of itself, also contemplate the impact of the virtual image, thus achieve the technique effect making beholder watch the displaying contents mated with the virtual image.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code.
The present invention describes with reference to according to the process flow diagram of the method for the embodiment of the present invention, equipment (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing device produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make on computing machine or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computing machine or other programmable devices is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
Specifically, the computer program instructions that two kinds of information processing methods in the embodiment of the present application are corresponding can be stored in CD, hard disk, on the storage mediums such as USB flash disk, when the computer program instructions corresponding with the first information processing method in storage medium is read by an electronic equipment or be performed, comprise the steps:
Obtain the image that image acquisition device is corresponding with acquisition range, wherein, the viewing scope of the display device of electronic equipment is mated with described acquisition range;
Process described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder watch from the specular-reflection unit overlapped with described display device with the picture of the symmetry of described beholder;
According to described result, control described display device and switch to second content of mating with the described virtual image from display first content.
Optionally, store in described storage medium with image described in step process to obtain result, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
According to described image, determine the digital viewing person coordinate in first coordinate system corresponding with described beholder, the second coordinate system of described first coordinate system and described acquisition range is symmetrical;
Identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area;
Based on described image, determine described viewpoint;
The coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device;
According to the coordinate of described second area under described three-coordinate, determine described first area.
Optionally, described second content comprises the region instruction of described first area, and the instruction of described region is mated with the described virtual image.
Optionally, what store in described storage medium controls described display device with step and switches to second content of mating with the described virtual image from showing first content, and corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
The display mode of described first area is adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image; Or
The boundary line of described first area is shown, to strengthen the perception of described beholder to described boundary line with Third Way.
Optionally, other computer instruction is also stored in described storage medium, these computer instructions with step: controlling described display device and be performed from showing after first content switches to second content of mating with the virtual image of described beholder, comprising the steps: when being performed
Show at least one mobile logo on said display means, described mobile logo moves in described first area.
Optionally, what store in described storage medium controls described display device with step and switches to second content of mating with the described virtual image from showing first content, and corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
When described first content comprises at least one object, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches;
At least one object described is adjusted to outside described first area, to obtain described second content, or the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image.
Optionally, store in described storage medium with step according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
Determine partly or entirely being arranged in and described first area of at least one object described;
What store in described storage medium is adjusted to step the 6th mode being different from described 5th mode from the 5th mode by the display mode of at least one object described, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (19)
1. an information processing method, described method comprises:
Obtain the image that image acquisition device is corresponding with acquisition range, wherein, the viewing scope of the display device of electronic equipment is mated with described acquisition range;
Process described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder watch from the specular-reflection unit overlapped with described display device with the picture of the symmetry of described beholder;
According to described result, control described display device and switch to second content of mating with the described virtual image from display first content.
2. the method for claim 1, is characterized in that, processes described image to obtain result, comprising:
According to described image, determine the digital viewing person coordinate in first coordinate system corresponding with described beholder, the second coordinate system of described first coordinate system and described acquisition range is symmetrical;
Identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area;
Based on described image, determine described viewpoint;
The coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device;
According to the coordinate of described second area under described three-coordinate, determine described first area.
3. method as claimed in claim 2, is characterized in that, described second content comprises the region instruction of described first area, and the instruction of described region is mated with the described virtual image.
4. method as claimed in claim 3, is characterized in that, controls described display device and switches to second content of mating with the described virtual image from display first content, comprising:
The display mode of described first area is adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image; Or
The boundary line of described first area is shown, to strengthen the perception of described beholder to described boundary line with Third Way.
5. the method as described in claim 3 or 4, is characterized in that, after from display, first content switches to second content of mating with the virtual image of described beholder to the described display device of control, described method also comprises:
Show at least one mobile logo on said display means, described mobile logo moves in described first area.
6. method as claimed in claim 2, is characterized in that, according to described result, controls described display device and switches to second content of mating with the described virtual image from display first content, comprising:
When described first content comprises at least one object, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches;
At least one object described is adjusted to outside described first area, to obtain described second content, or the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image.
7. method as claimed in claim 6, is characterized in that, according to described first area, determines that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches, comprising:
Determine partly or entirely being arranged in and described first area of at least one object described;
The display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, comprises:
To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
8. an electronic equipment, comprising:
Input interface, is connected with treating apparatus and image collecting device, for by the image transmitting corresponding with acquisition range of described image acquisition device to described treating apparatus;
Display device, is connected with described treating apparatus; The viewing scope of described display device is mated with described acquisition range;
Specular-reflection unit, overlaps with described display device;
Described treating apparatus for the treatment of described image to obtain result, wherein, when there is beholder in described acquisition range, described result at least comprises determine according to described image corresponding with the virtual image of described beholder, and first area on said display means; Wherein, the described virtual image is mate with the viewpoint of described beholder, described beholder from described specular-reflection unit watch with the picture of the symmetry of described beholder; And according to described result, control described display device and switch to second content of mating with the described virtual image from display first content.
9. equipment as claimed in claim 8, it is characterized in that, described electronic equipment also comprises:
Touch-control input device, overlaps with described display device and described specular-reflection unit, for detecting touch-control input.
10. equipment as claimed in claim 9, is characterized in that, described specular-reflection unit overlaps on described display device first surface toward the outside, and described touch-control input device is arranged on described specular-reflection unit toward the outside second; Or
Described touch-control input device overlaps on described display device first surface toward the outside, and described specular-reflection unit overlaps on described touch-control input device toward the outside the 3rd.
11. equipment as claimed in claim 10, it is characterized in that, described specular-reflection unit is the specular layer of described display device, and described touch-control input device overlaps on described display device first surface toward the outside.
12. equipment as described in claim 10 or 11, it is characterized in that, described image collecting device is arranged on the primary importance of described display device, to make the imaging plane of described image collecting device parallel with the imaging plane of described display device or coplanar.
13. equipment as claimed in claim 8, it is characterized in that, described electronic equipment also comprises:
Voice collection device, is connected with described treating apparatus, for gathering the sound of described beholder;
Described treating apparatus is analyzed described sound, determines the steering order that described sound is corresponding; Perform the steering order of described correspondence.
14. equipment as claimed in claim 8, it is characterized in that, described treating apparatus is used for according to described image, determines the digital viewing person coordinate in first coordinate system corresponding with described beholder, and the second coordinate system of described first coordinate system and described acquisition range is symmetrical; Identify described digital viewing person, to obtain the second area of described digital viewing person, and determine the coordinate of described second area under described first coordinate system, described second area is corresponding with described first area; Based on described image, determine described viewpoint; The coordinate under described first coordinate system according to described viewpoint and described second area, obtains described second area coordinate under the three-coordinate of described display device; According to the coordinate of described second area under described three-coordinate, determine described first area.
15. equipment as claimed in claim 14, is characterized in that, described second content comprises the region instruction of described first area, and the instruction of described region is mated with the described virtual image.
16. equipment as claimed in claim 15, is characterized in that, described treating apparatus is used for the display mode of described first area being adjusted to the second method being different from described first method from first method, to strengthen the perception of described beholder to the described virtual image; Or treating apparatus to show the boundary line of described first area with Third Way for controlling display device, show the part within described boundary line, to strengthen the perception of described beholder to described boundary line with the fourth way being different from described Third Way.
17. equipment as described in claim 15 or 16, it is characterized in that, described display device is also for after controlling described display device first content switching to second content of mating with the virtual image of described beholder from display at described treating apparatus, show at least one mobile logo, described mobile logo moves in described first area.
18. equipment as claimed in claim 14, it is characterized in that, described treating apparatus is used for comprising at least one object when described first content, according to described first area, determine that at least one object described of described first content is located in described first area corresponding to the described virtual image that described beholder watches; At least one object described is adjusted to outside described first area, to obtain described second content, or the display mode of at least one object described is adjusted to the 6th mode being different from described 5th mode from the 5th mode, to obtain described second content, thus strengthen the perception of described beholder to the described virtual image;
Described display device is for showing described second content.
19. equipment as claimed in claim 18, is characterized in that, described treating apparatus is for determining partly or entirely being arranged in and described first area of at least one object described; To the part or all of display mode of described first area be arranged in, be adjusted to described 6th mode from described 5th mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510281993.9A CN104850383B (en) | 2015-05-27 | 2015-05-27 | A kind of information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510281993.9A CN104850383B (en) | 2015-05-27 | 2015-05-27 | A kind of information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104850383A true CN104850383A (en) | 2015-08-19 |
| CN104850383B CN104850383B (en) | 2018-06-01 |
Family
ID=53850049
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510281993.9A Active CN104850383B (en) | 2015-05-27 | 2015-05-27 | A kind of information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104850383B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095232A (en) * | 2016-06-06 | 2016-11-09 | 联想(北京)有限公司 | A kind of method for information display and electronic equipment |
| CN111223105A (en) * | 2018-11-23 | 2020-06-02 | 北京字节跳动网络技术有限公司 | Image processing method and device |
| CN111553037A (en) * | 2020-05-09 | 2020-08-18 | 合肥学院 | Spiral rotor modeling method based on virtual generating machining |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102831856A (en) * | 2012-07-17 | 2012-12-19 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN103514545A (en) * | 2012-06-28 | 2014-01-15 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN103578449A (en) * | 2012-08-08 | 2014-02-12 | 联想(北京)有限公司 | Display device and display processing method |
| US20140049540A1 (en) * | 2011-03-28 | 2014-02-20 | Kabushiki Kaisha Toshiba | Image Processing Device, Method, Computer Program Product, and Stereoscopic Image Display Device |
-
2015
- 2015-05-27 CN CN201510281993.9A patent/CN104850383B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140049540A1 (en) * | 2011-03-28 | 2014-02-20 | Kabushiki Kaisha Toshiba | Image Processing Device, Method, Computer Program Product, and Stereoscopic Image Display Device |
| CN103514545A (en) * | 2012-06-28 | 2014-01-15 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN102831856A (en) * | 2012-07-17 | 2012-12-19 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN103578449A (en) * | 2012-08-08 | 2014-02-12 | 联想(北京)有限公司 | Display device and display processing method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095232A (en) * | 2016-06-06 | 2016-11-09 | 联想(北京)有限公司 | A kind of method for information display and electronic equipment |
| CN106095232B (en) * | 2016-06-06 | 2019-11-26 | 联想(北京)有限公司 | A kind of information display method and electronic equipment |
| CN111223105A (en) * | 2018-11-23 | 2020-06-02 | 北京字节跳动网络技术有限公司 | Image processing method and device |
| CN111223105B (en) * | 2018-11-23 | 2021-06-22 | 北京字节跳动网络技术有限公司 | Image processing method and device |
| CN111553037A (en) * | 2020-05-09 | 2020-08-18 | 合肥学院 | Spiral rotor modeling method based on virtual generating machining |
| CN111553037B (en) * | 2020-05-09 | 2023-03-14 | 合肥学院 | A Modeling Method of Helical Rotor Based on Virtual Fan Cheng Machining |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104850383B (en) | 2018-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12210691B2 (en) | Smart ring for manipulating virtual objects displayed by a wearable device | |
| US10942585B2 (en) | Trackability enhancement of a passive stylus | |
| US11195341B1 (en) | Augmented reality eyewear with 3D costumes | |
| CN112513780A (en) | Replacement of 2D images with 3D images | |
| US9467685B2 (en) | Enhancing the coupled zone of a stereoscopic display | |
| US10866820B2 (en) | Transitioning between 2D and stereoscopic 3D webpage presentation | |
| US20210405955A1 (en) | Eyewear including multi-user, shared interactive experiences | |
| US20170102791A1 (en) | Virtual Plane in a Stylus Based Stereoscopic Display System | |
| EP4586038A2 (en) | Visual-inertial tracking using rolling shutter cameras | |
| US12169968B2 (en) | Augmented reality eyewear with mood sharing | |
| US20230161959A1 (en) | Ring motion capture and message composition system | |
| US20180205939A1 (en) | Stereoscopic 3D Webpage Overlay | |
| US11803239B2 (en) | Eyewear with shared gaze-responsive viewing | |
| CN104850383A (en) | Information processing method and electronic equipment | |
| CN112513779B (en) | Identify replacement 3D images for 2D images by ranking criteria | |
| Piérard et al. | I-see-3D! An interactive and immersive system that dynamically adapts 2D projections to the location of a user's eyes | |
| US12474791B2 (en) | Six-degree of freedom pose estimation of a stylus | |
| US20250053245A1 (en) | Six-degree of Freedom Pose Estimation of a Stylus | |
| US20250131590A1 (en) | Screen Position Estimation | |
| CA3114040A1 (en) | Augmented reality system and method for substrates, coated articles, insulating glass units, and/or the like | |
| CN205139892U (en) | Electronic device | |
| WO2022185719A1 (en) | Information processing device, information processing method, and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |