CN103718564B

CN103718564B - Reception device, method of reseptance and information processing system

Info

Publication number: CN103718564B
Application number: CN201280038061.6A
Authority: CN
Inventors: 北里直久
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2011-08-05
Filing date: 2012-07-25
Publication date: 2018-01-09
Anticipated expiration: 2032-07-25
Also published as: KR20140053984A; JPWO2013021824A1; RU2014103001A; EP2741497A1; US11019406B2; US9998801B2; TW201309007A; MX2014001202A; KR102060449B1; CN103718564A; CA2843382C; CA2843382A1; US20130198768A1; US20190007751A1; WO2013021824A1; US20150074704A1; JP6208012B2; RU2594000C2; US8938756B2; TWI528822B

Abstract

This technology is related to reception device, method of reseptance, program and information processing system, is configured as by using ACR technologies, using the teaching of the invention it is possible to provide the application program with digital television program linkage.Reception device receives AV contents, and from the extracting data feature of the AV contents received.Reception device is from the feature of extraction, the recognition result of the AV contents identified by using ACR technical limit spacings, then, according to the recognition result of acquisition, obtains for controlling the order with the operation of the application program of AV content linkages.According to the order of acquisition, reception device controls the operation of application program.This technology can be applied to for example receive the television receiver of digital TV broadcast signal.

Description

Receiving apparatus, receiving method, and information processing system

Technical Field

The present technology relates to a receiving apparatus, a receiving method, a program, and an information processing system, and particularly relates to a receiving apparatus, a receiving method, a program, and an information processing system configured to be able to provide an application program in conjunction with a digital television program by using an ACR technology.

Background

In a receiving apparatus that receives a digital television broadcast signal, a service that acquires an application linked with a digital television program from the internet and runs the program is expected to be widespread, and a technique for realizing a hybrid service of such broadcasting and communication is being studied (see, for example, patent document 1).

In addition, in the case where terrestrial broadcasting is not directly received but is received through a CATV network or a satellite communication network, research is being conducted to realize a hybrid service of broadcasting and communication by transmitting a control signal synchronized with a digital television broadcasting signal. However, it is currently difficult to implement such services unless facilities and dedicated terminals of a CATV network or a satellite communication network are updated.

[ list of cited documents ]

[ patent document ]

[PTL1]

JP2006-245653A

Disclosure of Invention

Technical problem to be solved by the invention

Incidentally, a technique for identifying a television program or similar AV contents, which is called ACR (Automatic Content Recognition), is known. In the ACR technique, AV content is identified by collating features extracted from video signals and audio signals of AV content as an identification target with a database in which features extracted from video signals and audio signals of a large amount of AV content are registered in advance.

If a digital television program is identified by using the ACR technique and an application corresponding to the identified program can be provided, a mixed service of broadcasting and communication can be realized. However, currently, a technical way to provide an application program linked with a digital television program by using the ACR technology has not been established.

The present technology has been made in view of such circumstances, so that it is possible to provide an application program linked with a digital television program by using the ACR technology.

Technical scheme for solving technical problem

The reception device of the first aspect of the present technology includes: a receiver which receives AV content; a feature extractor extracting features from the received data of the AV contents; and an identification result acquirer that acquires an identification result of the AV content identified from the extracted features by using an ACR (Automatic content recognition) technique. The receiving apparatus further includes: a command acquirer that acquires a command for controlling an operation of an application linked with the AV content, based on the acquired identification result; and a controller which controls an operation of the application program according to the acquired command.

The command represents any one of acquisition or registration, acquisition or activation, event initiation, interruption, or cessation of an application. The controller controls the acquisition or registration, acquisition or activation of the application program according to each command, or the triggering, interruption or stopping of an event of the running application program.

Time information is contained in the command, the time information indicating a time at which the command is executed, and the controller executes the command according to the time information.

The time information is information for executing a command at a specific time set in advance irrespective of the progress of the AV content, or information for executing a command when a specific time set in advance in conjunction with the progress of the AV content has elapsed.

If the command indicates acquisition or activation and the application is not acquired, the controller acquires the application and then activates the acquired application when it is time to execute the command.

The feature extractor extracts features from one or both of a video signal and an audio signal of the AV content.

The receiving device may be a stand-alone device or may be an internal module constituting one device.

The receiving method or program of the first aspect of the present technology is a receiving method or program corresponding to the receiving apparatus of the first aspect described above.

In the receiving apparatus, receiving method, and program of the first aspect of the present technology, AV content is received, and features are extracted from data of the received AV content. An identification result of the AV content identified from the extracted features by using the ACR technique is acquired, and a command for controlling an operation of an application program running in conjunction with the AV content is acquired according to the acquired identification result. And controlling the operation of the application program according to the acquired command.

An information processing system of a second aspect of the present technology includes: a receiving device, a 1 st information processing device, a 2 nd information processing device, and a 3 rd information processing device. In the information processing system, the reception apparatus includes: a receiver which receives AV content; a feature extractor extracting features from the received AV content data; and an identification result acquirer that transmits the extracted features to the 1 st information processing apparatus and acquires an identification result of the AV content identified from the features by using the ACR technique in the 1 st information processing apparatus. The receiving apparatus further includes: a command acquirer that transmits the identification result acquired from the 1 st information processing apparatus to the 2 nd information processing apparatus, and acquires a command for controlling an operation of an application that runs in conjunction with the AV content, corresponding to the acquired identification result, from the 2 nd information processing apparatus; and a controller that controls an operation of the application program acquired from the 3 rd information processing apparatus according to the command acquired from the 2 nd information processing apparatus. The 1 st information processing apparatus includes: and a content identifier for identifying the AV content according to the characteristics by using the ACR technique in response to the query from the receiving device. The 2 nd information processing apparatus includes: and a command provider for providing a command corresponding to the recognition result in response to the query from the receiving device. The 3 rd information processing apparatus includes: and an application provider for providing an application corresponding to the command in response to the query from the receiving apparatus.

In the information processing system of the second aspect of the present technology, AV content is received by the reception means, and features are extracted from data of the identified AV content. The extracted features are transmitted to the 1 st information processing apparatus, and in the 1 st information processing apparatus, the recognition result of the AV content recognized from the features by using the ACR technique is acquired. The acquired recognition result is transmitted from the 1 st information processing apparatus to the 2 nd information processing apparatus, and a command for controlling an operation of an application program that runs in conjunction with the AV content is acquired from the 2 nd information processing apparatus in accordance with the acquired recognition result. The operation of the application program acquired from the 3 rd information processing apparatus is controlled in accordance with the command acquired from the 2 nd information processing apparatus. With the 1 st information processing apparatus, AV content is identified from features by using the ACR technique in response to an inquiry from a receiving apparatus. By the 2 nd information processing apparatus, a command corresponding to the recognition result is provided in response to the inquiry from the receiving apparatus. By the 3 rd information processing apparatus, in response to the inquiry from the receiving apparatus, the application corresponding to the command is provided.

Effects of the invention

According to the present technology, an application linked with a digital television program can be provided by using the ACR technology.

Drawings

Fig. 1 is a diagram showing a configuration example of a broadcast system.

Fig. 2 is a diagram showing a configuration example of a receiving apparatus.

Fig. 3 is a sequence diagram for explaining cooperation processing between the reception apparatus and each server.

Fig. 4 is a diagram explaining the concept of the ACR technique.

Fig. 5 is a diagram showing an example of information items included in a command.

Fig. 6 is a diagram showing a detailed specification (specification) of a command.

Fig. 7 is a diagram showing detailed specifications of commands.

Fig. 8 is a diagram showing a description example of the command.

Fig. 9 is a diagram showing state transition of an application.

Fig. 10 is a diagram showing the relationship between each command and state transition.

Fig. 11 is a flowchart showing the command response processing.

Fig. 12 is a flowchart showing the synchronization control process.

Fig. 13 is a diagram illustrating an example of an operation scenario.

Fig. 14 is a diagram illustrating an example of an operation scenario.

Fig. 15 is a diagram showing a relationship between multiple applications.

Fig. 16 is a diagram illustrating an operation example between multiple applications.

Fig. 17 is a diagram showing a specific example of a broadcast system to which the present technology is applied.

Fig. 18 is a diagram showing a configuration example of a communication system.

Fig. 19 is a diagram showing a configuration example of a computer.

Reference numerals:

1 broadcasting system, 11 broadcasting device, 12 receiving device, 13ACR server, 14 command server, 15 application server, 51 tuner, 57 fingerprint extractor, 58 communication I/F, 60 command parser, 61 controller, 64 application engine, 81 communication system, 91 transmission server, 100 computer, 101CPU

Detailed Description

Embodiments of the present technology will be described below with reference to the drawings.

First embodiment

[ example of configuration of broadcast System ]

Fig. 1 shows a broadcasting system 1 of the present embodiment. The broadcasting system 1 is composed of a broadcasting device 11, a receiving device 12, an ACR server 13, an order server 14, and an application server 15. Further, the reception apparatus 12, the ACR server 13, the command server 14, and the application server 15 are connected to each other via a network 16.

The broadcaster 11 is configured to transmit (broadcast) a digital television broadcast signal equivalent to AV content of a digital television program.

The receiving device 12 receives the digital television broadcast signal transmitted from the broadcasting device 11, and acquires video and audio of a digital television program. The reception apparatus 12 outputs the acquired video to a display and outputs audio to a speaker.

The receiving device 12 may exist as a single device or may be integrated into, for example, a television receiver, video recorder, or the like. The detailed configuration of the reception apparatus 12 will be described later with reference to fig. 2.

The receiving apparatus 12 periodically accesses the ACR server 13 via the network 16 and inquires about the identification result of the digital television program. At this time, features (hereinafter also referred to as fingerprint information) extracted from the video signal and the audio signal of the digital television program are transmitted to the ACR server 13.

The ACR server 13 has a database in which features extracted from video signals and audio signals of arbitrary AV contents are registered, and identifies the AV contents by using an ACR (automatic content Recognition) technique in response to an inquiry from an arbitrary terminal device connected to the network 16. The ACR server 13 checks the fingerprint information from the reception apparatus 12 against the database to identify the digital television program, and transmits the identification result to the reception apparatus 12 via the network 16.

Based on the recognition result received from the ACR server 13, the receiving apparatus 12 accesses the command server 14 via the network 16, and acquires an operation for controlling an application program for data broadcasting (hereinafter referred to as a data broadcasting application) that operates in conjunction with a digital television program (AV content).

The command server 14 manages commands for controlling the operation of the data broadcasting application, and transmits the commands to the receiving device 12 through the network 16 in response to an inquiry of the receiving device 12.

The receiving device 12 controls the operation of the data broadcasting application according to the command received from the command server 14. Further, according to the command received from the command server 14, the reception apparatus 12 accesses the application server 15 through the network 16 and acquires the data broadcast application.

The application server 15 manages a data broadcast application executed in conjunction with a digital television program (AV content) broadcast by the broadcasting apparatus 11, and transmits the data broadcast application to the receiving apparatus 12 through the network 16 in response to an inquiry of the receiving apparatus 12.

The broadcast system 1 is configured in the above-described manner.

[ configuration example of receiving apparatus ]

Fig. 2 shows a configuration example of the reception apparatus 12 in fig. 1.

The reception apparatus 12 is composed of a tuner 51, a demultiplexer 52, an audio decoder 53, an audio output section 54, a video decoder 55, a video output section 56, a fingerprint extractor 57, a communication I/F58, a clock synchronizer 59, a command parser 60, a controller 61, a memory 62, an operation section 63, a cache 65, and an application memory 66.

The tuner 51 receives and demodulates a digital television broadcast signal corresponding to a channel selected by a user, and outputs a Transport Stream (hereinafter referred to as TS) acquired as a result to the demultiplexer 52.

The demultiplexer 52 separates the TS input from the tuner 51 into an audio encoded signal and a video encoded signal, and outputs the respective signals to the audio decoder 53 and the video decoder 55. Further, the demultiplexer 52 extracts a PCR (Program Clock Reference) from the TS packets constituting the TS and supplies it to the Clock synchronizer 59.

The audio decoder 53 decodes the input audio encoded signal and outputs the resultant audio signal to the audio output section 54 and the fingerprint extractor 57, and the audio output section 54 outputs the input audio signal to a speaker located at a rear stage.

The video decoder 55 decodes the input video encoded signal and outputs the resultant video signal to the video output section 56 and the fingerprint extractor 57, and the video output section 56 outputs the video signal input from the video decoder 55 to a display located at a subsequent stage.

The audio signal from the audio decoder 53 and the video signal from the video decoder 55 are supplied to a fingerprint extractor 57, and the fingerprint extractor 57 extracts features from either or both of the audio signal and the video signal and supplies them as fingerprint information to a communication I/F58.

The communication I/F58 transmits the fingerprint information from the fingerprint extractor 57 to the ACR server 13 through the network 16. Further, the communication I/F58 receives the identification result of the digital television program transmitted from the ACR server 13, and supplies it to the controller 61.

The controller 61 runs a control program stored in advance in the memory 62, thereby controlling the operations of the respective units of the reception apparatus 12. A control program run by the controller 61 is stored in advance in the memory 62. This control program may be updated based on the digital television broadcast signal or update data acquired through the network 16. The operation section 63 accepts various operations by the user, and notifies the controller 61 of corresponding operation signals.

Further, according to the recognition result from the communication I/F58, the controller 61 controls the communication I/F58, accesses the command server 14 through the network 16, and inquires for a command. The communication I/F58 receives a command transmitted from the command server 14 and supplies it to the command parser 60.

The command parser 60 parses the command from the communication I/F58 and supplies the parsed result to the controller 61.

The clock synchronizer 59 is constituted by, for example, a PLL (Phase Locked Loop), and supplies a system clock according to PCR from the demultiplexer 52 to the respective units of the reception apparatus 12, such as the audio decoder 53, the video decoder 55, and the controller 61. Accordingly, the system clock synchronized with the broadcasting apparatus 11 can be obtained in the receiving apparatus 12, and thus the audio signal and the video signal can be reproduced.

The controller 61 controls acquisition or registration, acquisition or activation (execution), event triggering (event notification), interruption, stop, and the like of a data broadcasting application linked with a digital television program (AV content) based on the analysis result from the command analyzer 60. Meanwhile, based on the analysis result from the command parser 60, the controller 61 controls the timing of command execution with reference to the system clock from the clock synchronizer 59.

The application engine 64 controls the communication I/F58 to access the application server 15 through the network 16 and request a data broadcasting application according to the control of the controller 61. The communication I/F58 receives the data broadcast application transmitted from the application server 15 and holds it in the cache 65.

The application engine 64 reads out and executes the data broadcasting application retained in the cache memory 65 according to the control of the controller 61, and the video signal of the data broadcasting application in operation is supplied to the video output section 56.

The video output section 56 synthesizes the video signal input from the application engine 64 and the video signal input from the video decoder 55, and outputs the synthesized signal to a display located at a subsequent stage.

The application memory 66 is composed of a work memory 66A and a save memory 66B. The application engine 64 records data (specifically, a hierarchy including information to be displayed, etc.) relating to the data broadcasting application in operation in the work memory 66A. In addition, when the running data broadcast application is suspended, the application engine 64 moves the data of the work memory 66A of the application memory 66 to the save memory 66B. Then, when resuming the suspended data broadcasting application, the application engine 64 moves the data in the save memory 66B to the work memory 66A to resume the state before the suspension.

The receiving device 12 is configured in the manner described above.

[ collaboration between a receiving apparatus and each server ]

Fig. 3 is a sequence diagram illustrating a process of activating a data broadcast application as an example of the process in which the reception apparatus 12 cooperates with each server.

When the user selects a desired channel in the receiving apparatus 12, the broadcasting apparatus 11 receives the digital television broadcast signal, and the video of the corresponding digital television program is displayed on the display (S11). In addition, in the receiving apparatus 12, features are periodically extracted from the video signal and the audio signal corresponding to the digital television program (S12), and these features are transmitted as fingerprint information to the ACR server 13 (S13).

The ACR server 13 performs an ACR identification process (S14) to identify the digital television program currently selected in the reception apparatus 12 by checking the fingerprint information from the reception apparatus 12 against the database. Specifically, as shown in fig. 4, in the ACR server 13, when an inquiry by fingerprint information is received from the reception apparatus 12, the digital television program currently selected in the reception apparatus 12 is identified by the ACR identification processing part 13A checking the fingerprint information with the FP database 13B prepared in advance.

The fingerprint information (feature) is, for example, unique information of all or part of the constituent elements of the AV content, and a large amount of unique information of the AV content is registered in advance in the FP database 13B. In the ACR recognition process, for example, the degree of similarity coincidence of these unique information is determined. As a method of determining the degree of similarity or the degree of agreement, a known technique disclosed in various documents and the like can be used. By using the ACR technique, AV content can be identified from characteristics of video signals and audio signals without depending on information such as resolution, aspect ratio, bit rate, or format of the AV content.

By this ACR identification processing, information indicating a channel number of a digital television program (hereinafter referred to as channel program information) and information indicating a time position at which fingerprint information when a period from the start to the end of the digital television program is indicated on the time axis is extracted (hereinafter referred to as time position information) are acquired. In addition, in the FP database 13B, information indicating a command acquisition source (hereinafter referred to as command provider information) for controlling an operation of a data broadcasting application executed in conjunction with a program is stored in association with the channel number information. The command provider information includes, for example, a URL (Uniform Resource Locator) of the command server 14.

The ACR identification processing part 13A acquires the command provider information corresponding to the identified channel number from the FP database 13B, and then, as the identification result of the identification process, the ACR identification processing part 13A transmits the channel program information, the time position information, and the command provider information to the receiving apparatus 12 of the query issuer (S15).

The reception apparatus 12 acquires the recognition result from the ACR server 13 and analyzes the recognition result (S16). In addition, according to the analysis result of the recognition result, the receiving device 12 accesses the command server 14 having the URL described in the command provider information, and transmits the channel number information and the time position information, thereby inquiring about the command that can be executed in the receiving device 12 (S17).

In response to the inquiry from the receiving apparatus 12, the command server 14 transmits a command according to the channel number information and the time position information to the receiving apparatus 12 (S19).

The reception apparatus 12 acquires the command from the command server 14 and parses the command (S20). In addition, based on the result of the analysis of the command, the receiving apparatus 12 accesses the application server 15 and requests a data broadcast application to be executed in conjunction with the currently selected digital television program (S21).

In response to the application request from the reception apparatus 12, the application server 15 transmits the data broadcast application to the reception apparatus 12 (S23).

The receiving apparatus 12 acquires the data broadcast application from the application server 15 and executes (activates) this data broadcast application (S24).

As described above, by the reception apparatus 12 cooperating with the ACR server 13, the command server 14, and the application server 15, the data broadcast application linked with the currently selected digital television program is activated in the reception apparatus 12.

[ Command details ]

Fig. 5 shows an example of information items included in a command.

The "command ID" is information for identifying the command. If commands of the same content are transmitted multiple times, the command IDs of the respective commands are the same.

The "command effective time" is specified by any one of "absolute time and date", "relative time", or "PTS" representing the time when the command is executed. The "absolute time and date" is specified such that the command is executed regardless of the progress of the digital television program, for example, when the current time and date becomes a specific time and date set in advance. In addition, the "relative time" is specified such that a command is executed when a certain time elapses from the time based on the digital television program. For example, as the relative time, a relative time from the start time of the digital television program is specified. Further, "PTS" is specified as a command to be executed by using PTS (Presentation Time Stamp), which is Time information for performing synchronized playback. That is, in addition to the manner of specifying the command validation Time on the basis of the hour, minute, and second, a manner of specifying the command validation Time on the basis of an STC (System Time Clock) value of the TS may be employed.

If the current time has passed the command validation time, the command is executed immediately upon receipt.

In the "command object device type", a device that is an object controlled by the data broadcasting application of this command is specified. Here, in addition to the receiving apparatus main body (receiving apparatus 12), if an external apparatus is connected to the receiving apparatus 12, the external apparatus is specified as a target device of the command.

"Command action" means that the command is one of the following: "application get (Register)", "application activate (Execute)", "application stop (Terminate )", "event raise (Inject _ event)", and "application interrupt (Suspend)".

The Register command is a command for instructing the receiving apparatus 12 to acquire or Register the data broadcasting application. Here, the registration of the data broadcasting application means storing the acquired priority and validity period of the data broadcasting application in association with the data broadcasting application. The data broadcasting application is managed by the controller 61 according to the priority and the retention period.

The Execute (Execute) command is a command for instructing the reception apparatus 12 to acquire or activate a data broadcast application.

The termination (termination) command is a command for causing the reception apparatus 12 to stop running the data broadcast application.

The Inject event (Inject _ event) command is a command for causing the reception apparatus 12 to raise an event in a data broadcasting application in operation.

The Suspend (Suspend) command is a command for causing the reception apparatus 12 to Suspend the data broadcast application in operation.

The "command application diversification parameter" is a parameter for randomly dispersing the timing at which a command is applied in an object device such as the reception apparatus 12. By this parameter, the access timing to the command server 14 and the application server 15 is adjusted, and therefore, it is possible to disperse access to the servers and reduce the load.

The "application ID" is identification information of the data broadcasting application corresponding to this command. The "application type" is information indicating the type of the data broadcasting application corresponding to this command. The "operator ID" is identification information of an operator (such as a broadcasting station or the like) who develops an execution service of the data broadcasting application corresponding to this command.

The "application URL" is information indicating a URL of an acquisition source of the data broadcasting application when the command action is "application acquisition" or "application activation". The "application validity period" is information indicating the validity period of the data broadcasting application. Further, "application holding priority" is information indicating priority when acquiring and holding the data broadcast application corresponding to this command. If the data broadcasting application is registered, an application validity period and a retention priority of the data broadcasting application are stored, and the data broadcasting application is managed according to the validity period and the priority.

The "event ID" is identification information of an event that should be raised in the data broadcasting application specified by the application ID if the command action is "event raising". In addition, if the command operation is "event initiation", the "event additional data" describes data to be referred to in the event initiation.

Here, detailed specification of the command is shown in fig. 6 and 7.

The command elements mainly include a timing element, a diffusion element, an application element, and an event element, in addition to a destination attribute and an action attribute.

The destination attribute corresponds to the "command object device type" in fig. 5. For example, if the target apparatus of the command is the receiving device 12, it is designated as "receiver" in the target attribute, and if the target apparatus of the command is the external device, it is designated as "external _ 1" or "external _ 2".

The action attribute corresponds to "command action" in FIG. 5. For example, if an instruction for acquisition or activation of a data broadcast application is made, it is specified as "execute" (execution) in the action attribute. If an instruction for acquisition or registration of the data broadcasting application is made, it is designated as "register". If an instruction for interruption of the data broadcasting application is made, it is designated as "suspend". Further, if an instruction to stop the data broadcasting application is made, it is designated as "terminate" in the action attribute, and if an event is raised in the data broadcasting application in operation, it is designated as "event".

the timing element corresponds to the "command validation time" in fig. 5. As an attribute of the timing element, there is a "unit" attribute. For example, if "absolute time and date" is used, it is designated "utc" in the unit attribute. Further, if "relative time" is used, it is designated as "smpte", and if "PTS" is used, it is designated as "PTS".

The dispersion element corresponds to "command application diversification parameter" in fig. 5. The attributes of the dispersion element include a rate attribute, a range attribute, and a period attribute, and the number of times of distribution, the maximum delay time, and the command application dispersion period are specified by the attributes.

The application element corresponds to "application ID", "application type", "application URL", "application retention priority", and "application validity period" in fig. 5, and the ID attribute, the type attribute, the URL attribute, and the expire _ date attribute are designated. If the action attribute is "execute" or "register", the url attribute and the expire _ date attribute are required items. Further, "0" is usually specified in the priority attribute, and if the priority is set to be high, "1" is specified.

The event element corresponds to "event ID" and "event additional data" in fig. 5, and an ID attribute and a data attribute are specified. If the action attribute is "event," the event element is a required item.

[ description of commands ]

Fig. 8 is a diagram showing an example of the description of the command.

In the example of fig. 8, in the command element, the destination attribute is designated as "receiver" and the action attribute is designated as "execute". That is, this command is an execution command issued to the reception apparatus 12.

the timing element and the application element are written between the start tag and the end tag of the command element.

In the timing element, "pts" is specified as the unit attribute and "1286743" is specified as its value. I.e., the command is executed when the clock of "1286743" passes.

In the application element, "1" is designated as an id attribute and "html" is designated as a type attribute. In addition, "xxx.com/yyy" is designated as the url attribute and "2011-01-21" is designated as the expire _ date attribute. That is, this means that a data broadcast application described by HTML (Hyper Text Markup Language) can be acquired from the application server 15 specified by the URL "xxx.

The method of explaining the command is arbitrary and is not limited to fig. 8.

[ State transition of data broadcasting application ]

Fig. 9 is a state transition diagram of the data broadcasting application that runs in the receiving apparatus 12 in response to various commands such as registration, execution, injection of an event, suspension, and termination. As shown, the state of the data broadcasting application is defined to be converted into any one of four states, i.e., a Released state (Released), a Ready state (Ready), an Active state (Active), and a Suspended state (Suspended).

The release state indicates a state in which the data broadcasting application has not been acquired into the receiving apparatus 12. The ready state indicates a state in which the data broadcast application has been registered into the receiving device 12 but is not activated. The active state is a state in which the data broadcasting application is activated and operated. The suspended state indicates a state in which the execution of the data broadcasting application is interrupted and state information at the time of the interruption is retained in the save memory 66B.

When the data broadcast application transitions to the release state (has not yet been acquired to the receiving device 12), a transition to the ready state occurs if a registration command is received and the data broadcast application is acquired (registered) according to this registration command.

When the data broadcast application is in the ready state, a transition to the active state occurs if an execution command is received and the data broadcast application is activated in accordance with the execution command.

Further, when the data broadcast application is shifted to the release state (has not been acquired to the receiving apparatus 12), if an execution command is received and the data broadcast application is acquired and activated in accordance with the execution command, a shift to the active state occurs.

When the data broadcasting application transitions to the active state, a transition to the suspended state occurs if a suspend command is received and the execution of the data broadcasting application is interrupted according to the suspend command.

When the data broadcasting application transitions to the suspended state, a transition to the active state occurs if an execution command is received and the interrupted data broadcasting application is resumed according to the execution command.

When the data broadcasting application transitions to the active state or the suspended state, if a termination command is received and the operation of the data broadcasting application is stopped according to the termination command, the transition to the ready state occurs ("a" in the drawing). In addition, in addition to the transition based on the termination command, the transition to the ready state may also occur when other data broadcasting applications are executed.

Further, when the data broadcasting application transitions to the ready state, the active state, or the suspended state, if the application validity period of the command has elapsed, the transition to the release state occurs ("B" in the drawing).

Fig. 10 shows the relationship between the commands and the state transitions.

Fig. 10 schematically shows a case where, in the reception apparatus 12, fingerprint information extracted from data of AV content such as a digital television program is transmitted to the ACR server 13, various kinds of commands are acquired from the command server 14, and a data broadcast application is acquired from the application server 15.

In the reception apparatus 12, when the data broadcast application is shifted to the release state (has not been acquired to the reception apparatus 12 yet), if the data broadcast application is acquired and held to be registered in response to the registration command, the shift to the ready state occurs.

In the reception apparatus 12, when the data broadcasting application is in the ready state, if the data broadcasting application is activated in response to the execution command, a transition to the active state occurs.

Further, on other devices than the reception device 12, when the data broadcast application is shifted to the release state (has not been acquired to the other devices yet), if the data broadcast application is acquired and activated in response to the execution command, the shift to the active state occurs.

In the reception apparatus 12, when the data broadcasting application transitions to the active state, if an event is raised in the data broadcasting application in operation in response to the injection event command, the state remains in the active state.

In the reception apparatus 12, when the data broadcast application is transitioned to the active state, if the execution of the data broadcast application is interrupted in response to the pause command, the transition to the pause state occurs. Further, in the reception apparatus 12, when the data broadcast application is transitioned to the suspended state, if the interrupted data broadcast application is resumed in response to the execution command, the transition to the active state occurs.

Further, in the reception apparatus 12, when the data broadcast application transitions to the active state, if the execution of the data broadcast application is stopped in response to the termination command, the transition to the ready state occurs. When the data broadcasting application transitions to the ready state, the active state or the suspended state, if the application validity period of the data broadcasting application has passed, the data broadcasting application is cleared from the cache 65 and the registration is deleted, and then the transition to the release state occurs.

[ Command response processing ]

Next, with reference to fig. 11, a command response process when the receiving apparatus 12 receives a command will be explained below.

Fig. 11 is a flowchart explaining the command response processing. This command response process is repeatedly executed when the user is watching a digital television program, i.e., when the receiving apparatus 12 receives a digital television broadcast signal.

In step S11, the fingerprint extractor 57 determines whether a predetermined time has elapsed, and extracts fingerprint information from the video signal and the audio signal according to the digital television program after waiting for the predetermined time to elapse (step S12). That is, the fingerprint extractor 57 periodically performs extraction of fingerprint information at predetermined intervals such as several seconds.

In step S13, the fingerprint extractor 57 controls the communication I/F58, transmits the extracted fingerprint information to the ACR server 13 via the network 16, and inquires of the identification result of the currently selected digital television program. In the ACR server 13, based on the fingerprint information, ACR identification processing is performed, and the identification result is transmitted to the receiving apparatus 12. If the recognition result of the digital television program is not obtained in the ACR server 13, the transmission of the recognition result is not performed.

In step S14, the controller 61 controls the communication I/F58 to determine whether or not the identification result is received from the ACR server 13 that is the inquiry target of the identification result.

If it is determined in step S14 that the recognition result has not been received, the process returns to step S11, and the subsequent processes are repeated. For example, if the fingerprint information is extracted when the channel on which the broadcast is currently paused is selected in the receiving apparatus 12, the program cannot be identified on the ACR server 13 side, and the transmission of the identification result is not performed (the identification result may be transmitted, but it indicates that the corresponding program does not exist).

On the other hand, if it is determined in step S14 that the recognition result is received, the process proceeds to step S15. In step S15, the controller 61 parses the identification result of the currently selected digital television program received through the communication I/F58. Here, as the identification result, the channel number information, time position information, and command provider information of the currently selected digital television program are obtained.

In step S16, the controller 61 controls the communication I/F58 to access the command server 14 corresponding to the URL indicated by the command provider information, and transmits the channel number information and the time position information. Thereby, the controller 61 inquires about a command that can be executed in the reception apparatus 12. In the digital television program corresponding to the channel number information, the command server 14 acquires a command executable in a time slot corresponding to the time position information, and transmits the command to the receiving apparatus 12.

In step S17, the controller 61 controls the communication I/F58 to determine whether a command is received from the command server 14 that is the inquiry target of the command.

If it is determined in step S17 that the command has not been received, the process returns to step S11, and the subsequent processes are repeated. For example, in the command server 14, if there is no command that conforms to the conditions specified by the channel number information and the time position information, the transmission of the command is not performed (it is also possible that the command is transmitted, but indicates that no processing is required).

On the other hand, if it is determined in step S17 that the command is received, the process proceeds to step S18. In step S18, the command parser 60 reads out the command ID contained in the command, and determines whether the processing of step S19 and subsequent steps has been performed on this command. If it is determined that the processing of step S19 and subsequent steps has been performed, the process returns to step S11, and the subsequent processing is repeated. On the other hand, if it is determined that the processing of step S19 and subsequent steps has not been performed for this command, the process proceeds to step S19.

In step S19, the command parser 60 reads out the command action contained in the command, and discriminates which command is a Register (Register), Execute (Execute), Terminate (Terminate), Inject event (Inject _ event), or Suspend (Suspend).

In step S20, the command parser 60 determines whether the determination result of step S19 is registration (Register). If it is determined that the discrimination result is the registration (Register), the process proceeds to step S21.

In step S21, the controller 61 controls the communication I/F58 to access the application server 15 corresponding to the application URL of this command, letting the communication I/F58 acquire the data broadcast application specified by the application ID. The data broadcast application acquired by the communication I/F58 is retained in the cache memory 65. Further, the controller 61 stores its application validity period and application retention priority in the memory 62 in association with the acquired data broadcast application. Thus, the data broadcasting application retained in the cache memory 65 is managed by the controller 61 according to the validity period and the retention priority.

Thereafter, the process returns to step S11, and the subsequent process is repeated.

In step S20, if it is determined that the determination result of step S19 is not registration (Register), the process proceeds to step S22. In step S22, the controller 61 determines whether the determination result of step S19 is executed. If it is determined that this determination result is execution (Execute), the process proceeds to step S23.

In step S23, the application engine 64 determines whether the data broadcast application specified by the command ID thus commanded is dormant (in the suspended state) according to the control from the controller 61. Specifically, if data indicating the suspended state of the data broadcast application specified by the command ID is saved in the saving memory 66B, the application engine 64 determines that the data broadcast application is dormant.

In step S23, if it is determined that the data broadcast application specified by the command ID is not dormant, the process proceeds to step S24. In step S24, the application engine 64 acquires the data broadcast application specified by the command ID when it has not been acquired (absent in the cache 65) according to the control from the controller 61.

In step S25, the controller 61 executes a synchronization control process. Here, the details of the synchronization control process will be described with reference to the flowchart of fig. 12.

In step S51, the controller 61 determines whether the command validation time included in this command is set.

In step S51, if it is determined that the command validation time is set, the process proceeds to step S52. In step S52, the controller 61 determines whether it is time to execute the command.

This command effective time is specified by, for example, "absolute time and date", "relative time", or "PTS". In the judgment processing of step S52, if "absolute time and date" is specified, it is judged whether or not the current time and date has reached a preset specific time and date. Further, if the "relative time" is specified, it is determined whether or not a preset specific time has elapsed from the start time of the digital television program, for example. Further, if "PTS" is specified, it is determined whether it is time to execute the command based on the clock from the clock synchronizer 59.

In the determination processing of step S52, the determination processing is repeated until it is determined that it is time to execute the command. That is, the execution of the command may wait until it is time to execute the command.

Then, in step S52, if it is determined that it is time to execute the command, the process returns to step S25 in fig. 11, and the subsequent process is executed.

In step S26, if there is a currently running data broadcast application, the application engine 64 stops it according to the control from the controller 61. Then, in step S27, the application engine 64 activates the data broadcast application specified by the command ID in accordance with the control from the controller 61.

That is, due to the execution of the synchronization control process in step S25 (fig. 12), the data broadcast application is activated after the time for which the command is executed has elapsed. Thus, for example, a data broadcast application may be activated as a digital television program progresses, or may be activated at a particular time band.

Further, if the command validation time is not set (no in step S51 in fig. 12), step S52 in fig. 12 is skipped and steps S26 and S27 are executed immediately after the acquisition processing in step S24 ends. In this case, a data broadcast application that has not been acquired is acquired, and this data broadcast application is immediately activated.

Thereafter, the process returns to step S11, and the subsequent steps are repeated.

Further, in step S23, if it is determined that the data broadcast application specified by the command ID is hibernating (in a suspended state), the process proceeds to step S28.

In step S28, the controller 61 executes the synchronization control process of fig. 12. That is, if the command validation time is set, the process of step S29 is executed when it is time to execute the command. If the command validation time is not set, the process of step S29 is immediately executed.

In step S29, the application engine 64 moves the data in the save memory 66B to the work memory 66A according to the control from the controller 61, activating the data broadcast application specified by the command ID. Thus, the data broadcasting application in hibernation specified by the command ID is resumed from the suspended state. Thereafter, the process returns to step S11, and the subsequent steps are repeated.

In step S22, if it is determined that the determination result of step S19 is not execution (Execute), the process proceeds to step S30. In step S30, the controller 61 determines whether the determination result of step S19 is an injection event (Inject _ event). If it is determined that the discrimination result is the injection event (Inject _ event), the processing proceeds to step S31.

In step S31, the controller 61 executes the synchronization control process of fig. 12. That is, if the command validation time is set, the process of step S32 is executed when it is time to execute the command. If the command validation time is not set, the process of step S32 is immediately executed.

In step S32, the controller 61 controls the application engine 64 to cause (execute) an event corresponding to the event ID of the command in the running data broadcast application only when the command ID of this command coincides with the command ID of the running data broadcast application. Thereafter, the process returns to step S11, and the subsequent steps are repeated.

In step S30, if it is determined that the discrimination result of step S19 is not the injection event (Inject _ event), the processing proceeds to step S33. In step S33, the controller 61 determines whether the determination result of step S19 is suspended (Suspend). If it is determined that the determination result is pause (Suspend), the process proceeds to step S34.

In step S34, the controller 61 executes the synchronization control process of fig. 12. That is, if the command validation time is set, the process of step S35 is executed when it is time to execute the command. If the command validation time is not set, the process of step S35 is immediately executed.

In step S35, in accordance with control from the controller 61, the application engine 64 saves, in the save memory 66B, data indicating the state of the currently running data broadcast application (i.e., data currently written to the work memory 66A, including information indicating the hierarchical structure of the display information if there is a hierarchical structure in the display information). Thereafter, the process returns to step S11, and the subsequent steps are repeated.

In step S33, if it is determined that the determination result of step S19 is not pause (Suspend), the process proceeds to step S36 because the determination result of step S19 is Terminate (Terminate).

In step S36, the controller 61 executes the synchronization control process of fig. 12. That is, if the command validation time is set, the process of step S37 is executed when it is time to execute the command. If the command validation time is not set, the process of step S37 is immediately executed.

In step S37, if the data broadcast application specified by the command ID is running, the application engine 64 stops it according to the control from the controller 61. In step S38, the application engine 64 clears the data related to the data broadcast application specified by the command ID from the work memory 66A and the save memory 66B, and clears the data broadcast application from the cache 65, in accordance with the control from the controller 61. Thereafter, the process returns to step S11, and the subsequent steps are repeated.

The above description of the command response processing ends. The above-described command response processing enables activation of a data broadcast application, event initiation, and stop of the data broadcast application in conjunction with AV content (e.g., digital television programs, advertisements, etc.) of television broadcasts. Also, the data broadcasting application may be suspended while maintaining the active state, and other data information applications can be executed and stopped. Thereafter, the suspended data broadcasting application can be resumed from the suspended state.

Further, performing the command response process enables providing a data broadcasting application linked with the digital television program by using the ACR technique.

In the example of fig. 11, it is explained that from steps S24 to S27, the data broadcast application that has not been acquired is acquired (S24), and then, when it is time to execute the command (S25), the acquired data broadcast application is activated. However, the processing order of steps S24 and S25 may also be reversed. That is, in this case, the data broadcast application that has not been acquired is not acquired until the time of executing the command, and the data broadcast application that has not been acquired is not acquired and activated when the time of executing the command.

[ operational scenes ]

In the reception apparatus 12, performing the above-described command response processing enables the data broadcast application to function as in the examples in fig. 13 and 14.

Fig. 13 is a diagram showing an example of a running scenario when the command validation time is not set.

When a digital television program corresponding to a digital television broadcast signal from the broadcasting device 11 is displayed on the display, the receiving device 12 periodically extracts fingerprint information from a video signal or the like of a currently selected program and transmits it to the ACR server 13. On the ACR server 13 that received the fingerprint information, ACR identification processing is performed, and the identification result is transmitted to the reception apparatus 12.

The receiving apparatus 12 inquires the command server 14 about the command according to the recognition result from the ACR server 13. If there is no command that can be executed in the reception apparatus 12, no response from the command server 14 is executed.

Thereafter, in the reception apparatus 12, extraction of fingerprint information is periodically performed, and in association therewith, queries to the ACR server 13 and the command server 14 are also continuously performed. Then, if the reception apparatus 12 receives the execution command from the command server 14, the reception apparatus 12 accesses the application server 15 corresponding to the application URL, and acquires and executes the data broadcast application. Thus, on the digital television program displayed on the display, program-related information associated with the data broadcast application ("video synchronization application" in the drawing) and the like are displayed in a superimposed manner.

Further, in this state, if an execution command is received from the command server 14, the reception apparatus 12 ignores the execution command because the data broadcasting application has been activated. After that, the extraction of the fingerprint information is also continuously performed, and if the reception apparatus 12 receives the termination command from the command server 14, the reception apparatus 12 stops the data broadcasting application in operation. Therefore, on the display, the program-related information displayed in a superimposed manner on the program is deleted, and only the digital television program is displayed.

In the example of fig. 13, in the reception apparatus 12, the execution command and the termination command are explained as commands received from the command server 14. Of course, it is also possible to receive commands other than these. For example, the data broadcasting application is running, and if an injection event command is received, an event is raised in the running data broadcasting application, and if a pause command is received, the running data broadcasting application is paused.

As explained above, in the operation scenario of fig. 13, the command validation time is not set in the command transmitted by the command server 14, and therefore, the receiving apparatus 12 immediately executes the command received from the command server 14.

Fig. 14 is a diagram showing an example of a running scenario when the command validation time is set.

In fig. 14, the reception apparatus 12 periodically performs extraction of fingerprint information, and if the reception apparatus 12 receives an execution command from the ACR server 13, the application server 15 corresponding to the application URL is accessed to acquire a data broadcasting application. Further, since the command validation time is set in this execution command, after acquiring the data broadcast application, the reception apparatus 12 waits for the execution of the execution command until the time to execute the command ("synchronization wait" in the drawing). For example, if the program-related information linked with the data broadcast application is displayed in synchronization with a specific scene of the digital television program, the time synchronized with the specific scene is described as the command validation time, and therefore the data broadcast application is activated after waiting for the time of command execution. This enables the synchronization of a particular scene of a digital television program with program related information ("video synchronization application" in the figure).

Thereafter, the extraction of the fingerprint information is also continuously performed, and then, if the reception apparatus 12 receives the termination command from the command server 14, the reception apparatus 12 waits for the timing of the command execution to stop the data broadcasting application in operation. Thus, on the display, the program-related information displayed in a superimposed manner on the digital television program is deleted, and only this program is displayed.

In the example of fig. 14, in the reception apparatus 12, the execution command and the termination command are explained as commands received from the command server 14. Of course, it is also possible to receive commands other than these. For example, the data broadcasting application is running, and if an injection event command is received, it waits for the time to execute the command, and then causes an event in the running data broadcasting application. Further, the data broadcasting application is running, and if a pause command is received, it waits for the time to execute the command, and then the running data broadcasting application is paused.

As described above, in the operation scenario of fig. 14, since the command validation time is set in the command transmitted through the command server 14, the reception apparatus 12 waits for the timing of executing the command and then executes the command received from the command server 14. This enables the receiving apparatus 12 to execute a command at an arbitrary timing without depending on the resolution of fingerprint information extraction.

[ operation of multiple data broadcast applications ]

In the above, only the case where the data broadcasting application is activated in response to the execution command is described. However, the data broadcasting application can be activated without using the execution command.

Specifically, as shown in fig. 15, inside the data broadcast application App0 that is activated in response to the execution command, functions for activating other data broadcast applications App1, App2, and the like are described. This enables the data broadcast application App1 and the like to be activated in correspondence with the progress status of the data broadcast application App0, the operation of the data broadcast application App0 by the user, and the like.

Fig. 16 shows an example of the operation in which three data broadcast applications app0, app1, and app2 are cooperatively activated.

First, an execution command for the data broadcast application app0, a registration command for the data broadcast application app1, and a registration command for the data broadcast application app2 are broadcast. In the receiving device 12 that receives them, the data broadcast application app0 is acquired and registered for activation. On the screen of the executed data broadcasting application app0, icons corresponding to the data broadcasting application app1 and app2 are displayed, respectively. Meanwhile, the data broadcast application app1 and app2 are acquired and registered.

If the user selects an icon corresponding to the data broadcasting application app1 displayed on the data broadcasting application app0 screen, the running data broadcasting application app0 is stopped and the data broadcasting application app1 is activated. Thereafter, event triggering, pausing, resuming, and stopping of the data broadcast application app1 are performed in response to an inject event command, a pause command, an execute command, and a terminate command of the running data broadcast application app1, respectively.

If the user selects an icon corresponding to the data broadcasting application app2 displayed on the data broadcasting application app0 screen, the running data broadcasting application app0 is stopped and the data broadcasting application app2 is activated. Thereafter, event triggering and stopping of the data broadcast application app2 are performed in response to an inject event command and a terminate command of the running data broadcast application app2, respectively.

According to the above operation, a plurality of data broadcast applications can be activated in cooperation without using an execution command.

[ specific working examples ]

Further, according to the present technology, the identification of the AV content is performed by the ACR server 13 without metadata corresponding to the AV content. Thus, for example, the following operation is possible.

As shown in fig. 17, metadata related to a digital television program is given to AV content provided by a content provider (content provider), and a receiving apparatus ("TV 1" in the figure) that directly receives a digital television broadcast signal from an ASP (Authorized service provider) can acquire the metadata transmitted together with the AV content. Therefore, this reception apparatus is able to acquire and execute a data broadcast application by accessing an application Server ("Server" in the figure) managed by a broadcast station or the like based on the metadata.

On the other hand, when receiving a digital television broadcast signal from an ASP via a CATV network, a satellite communication network, or the like, a signal converted by a Set-Top Box ("STB (Set Top Box)" in the figure) is received by a receiving apparatus ("TV 2" in the figure) via an HDMI (High Definition Multimedia Interface). In this case, the output of the set-top box is only AV content and cannot utilize metadata. Therefore, this receiving apparatus can acquire a data broadcast application from an application Server (Server in the figure) by transmitting Fingerprint information ("fingerprintin" in the figure) extracted from AV content to an ACR Server (ACRSystem in the figure), and execute the data broadcast application.

As described above, when a digital television program is relayed via a CATV network, a satellite communication network, or the like, a service of data broadcast contents that can be linked with the program can also be realized.

Specifically, in the above description, an example is shown in fig. 1 as an example in which the receiving apparatus 12 directly receives the digital television broadcast signal from the broadcasting apparatus 11. However, the present technology is more effective when applied to a case where metadata transmitted together with AV content cannot be transmitted to a receiving device because a set-top box or the like is used, such as a CATV network, a satellite communication network, or the like.

< second embodiment >

[ configuration example of communication System ]

In the above description, an example was described in which the receiving apparatus 12 receives a digital television broadcast signal of AV content transmitted (broadcast) from the broadcasting apparatus 11. However, AV content may also be transmitted over the network 16.

Fig. 18 shows a communication system 81 as the present embodiment.

In fig. 18, portions corresponding to those of fig. 1 are given the same numerals, and the description thereof is omitted accordingly.

Specifically, in fig. 18, provided instead of the broadcaster 11 is a delivery server 91 connected to the network 16, when compared with fig. 1. In response to the request of the reception apparatus 12, the transmission server 91 transmits the AV content to the reception apparatus 12 through the network 16.

The receiving apparatus 12 extracts fingerprint information from the video signal and the audio signal of the AV content from the transmission server 91 and transmits it to the ACR server 13. In the ACR server 13, ACR identification processing is performed. Here, as the recognition result, the content identification information, the time position information, and the command provider information are transmitted. Specifically, although the channel number information is obtained as the identification result when the AV content from the broadcaster 11 is acquired, the content identification information such as the content ID is obtained as the identification result when the AV content from the delivery server 91 is acquired.

The receiving apparatus 12 accesses the command server 14 corresponding to the URL described in the command provider information, and transmits the content identification information and the time position information to inquire about a command executable in the receiving apparatus 12. Then, according to the command from the command server 14, the reception apparatus 12 controls the operation of the data broadcasting application.

In this way, the reception apparatus 12 can receive not only AV content through a broadcast network but also AV content through a communication network. In addition, regardless of whether the AV content is received from the broadcasting network or the communication network, it can be recognized by the ACR server 13. Therefore, the reception apparatus 12 can acquire the command according to the recognition result from the command server 14.

In the above description, an example has been described in which a plurality of servers such as the ACR server 13, the command server 14, and the application server 15 are provided for each provided function. However, all or part of these functions may be centralized and provided by one or more servers.

Further, the ACR server 13 may directly transmit the recognition result to the command server 14 without transmitting it to the reception apparatus 12. For example, when the reception apparatus 12 transmits fingerprint information to the ACR server 13, the ACR server 13 performs ACR identification processing and transmits the identification result to the command server 14. Then, the command server 14 transmits a command to the reception apparatus 12 according to the recognition result from the ACR server 13. This enables the following operations: the reception apparatus 12 acquires the command from the command server 14 by transmitting only the fingerprint information to the ACR server 13. Also, the command server 14 may directly transmit the acquisition command of the data broadcasting application to the application server 15 without transmitting it to the receiving device 12. This enables the following operations: for example, upon transmitting the fingerprint information to the ACR server 13, the reception apparatus 12 acquires the data broadcast application from the application server 15.

[ description of a computer to which the present technology is applied ]

The series of processes can be executed by hardware or software. When a series of processes is executed by software, a program constituting the software is installed in a general-purpose computer or the like.

Fig. 19 shows a configuration example of an embodiment of a computer mounted with a program that executes the series of processes described above.

The program may be recorded in advance in a recording unit 108 such as a hard disk or a ROM (read only Memory) 102 integrated in the computer 100.

Alternatively, the program may be temporarily or permanently stored (recorded) in a removable medium 111 such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, and a semiconductor Memory. Such removable media 111 may be provided as so-called software packages.

In addition to the installation from the above-described removable medium 111 to the computer 100, the program may be transmitted wirelessly from a download site to the computer 100 through an artificial satellite for digital satellite broadcasting, or may be transmitted to the computer 100 by wire through a network such as a LAN (Local area network) or the internet. In the computer 100, the program thus transmitted can be received through the communication unit 109 and installed in the recording unit 108.

The computer 100 includes a CPU (Central Processing Unit) 101. The input/output interface 105 is connected to the CPU101 through the bus 104. When an instruction is input via the input/output interface 105 by operating the input unit 106 composed of a keyboard, a mouse, a microphone, and the like by a user or the like, the CPU101 executes a program stored in the ROM102 according to the instruction. Alternatively, the CPU101 loads and runs a program stored in the recording unit 108 in a RAM (Random Access Memory) 103, a program received by the communication unit 109 and installed in the recording unit 108 transmitted from a satellite or a network, or a program read from a removable medium 111 loaded in the drive 110 and installed in the recording unit 108. Therefore, the CPU101 executes the processing according to the flowchart described above or the processing based on the configuration of the block diagram described above. Subsequently, the CPU101 causes the processing result to be output from an output unit 107 composed of an LCD (liquid crystal Display), a speaker, or the like, or causes the processing result to be transmitted from a communication unit 109 and recorded in a recording unit 108 or the like, as necessary, through, for example, the input/output interface 105.

Here, the processing steps of the program for causing the computer 100 to execute various kinds of processing described in this specification do not necessarily need to be processed in time series in the order described in the flowchart, and include processing executed in parallel or individually (for example, parallel processing or processing by an object).

Further, the program may be processed by one computer, or may be distributed by a plurality of computers. Further, the program may be transmitted to a remote computer and executed.

In this specification, a system refers to an apparatus as a whole composed of a plurality of apparatuses.

In addition, the embodiments of the present technology are not limited to the embodiments described above, and various changes may be made within a range not deviating from the gist of the present technology.

Further, the present technology may also have the following configuration.

[1] A receiving apparatus, comprising:

a receiver configured to receive AV content;

a feature extractor configured to extract features from the received data of the AV content;

an identification result acquirer configured to acquire an identification result of the AV Content identified from the extracted features by using an ACR (Automatic Content Recognition) technique;

a command acquirer configured to acquire a command for controlling an operation of an application program that runs in linkage with the AV content, according to the acquired recognition result; and

a controller configured to control an operation of the application program according to the acquired command.

[2] The reception apparatus according to [1], wherein,

the command represents any one of acquisition or registration, acquisition or activation, event initiation, interruption, or stoppage of the application; and is

The controller controls the acquisition or registration, acquisition or activation of the application program according to each command, or the event triggering, interruption or stopping of the application program in operation.

[3] The reception apparatus according to [1] or [2], wherein:

time information is contained in the command, the time information representing the time when the command is executed; and is

The controller executes the command according to the time information.

[4] The reception apparatus according to [3], wherein:

the time information is information for executing the command at a specific time set in advance irrespective of the progress of the AV content or information for executing the command when the specific time set in advance in linkage with the progress of the AV content elapses.

[5] The reception apparatus according to [3] or [4], wherein:

if the command indicates acquisition or activation and the application program is not acquired, the controller acquires the application program and then activates the acquired application program when it is time to execute the command.

[6] The reception apparatus according to any one of [1] to [5], wherein:

[7] A receiving method comprising the following steps performed by a receiving device:

receiving AV content;

extracting features from the received data of the AV content;

acquiring an identification result of the AV content identified from the extracted features by using an ACR technique;

acquiring a command for controlling an operation of an application program that operates in linkage with the AV content, according to the acquired recognition result; and

and controlling the operation of the application program according to the acquired command.

[8] A program that causes a computer to function as:

a receiver configured to receive AV content;

[9] An information processing system includes a receiving apparatus, a 1 st information processing apparatus, a 2 nd information processing apparatus, and a 3 rd information processing apparatus,

wherein,

the receiving device comprises

A receiver configured to receive AV content;

an identification result acquirer configured to transmit the extracted feature to the 1 st information processing apparatus and acquire an identification result of the AV Content identified from the feature by using an ACR (Automatic Content Recognition) technique in the 1 st information processing apparatus;

a command acquirer configured to transmit the identification result acquired from the 1 st information processing apparatus to the 2 nd information processing apparatus, and acquire a command for controlling an operation of an application program that runs in conjunction with the AV content, corresponding to the acquired identification result, from the 2 nd information processing apparatus; and

a controller configured to control an operation of the application program acquired from the 3 rd information processing apparatus in accordance with the command acquired from the 2 nd information processing apparatus,

the 1 st information processing apparatus includes

A content identifier configured to identify the AV content from the features by using an ACR technique in response to a query from the receiving device;

the 2 nd information processing apparatus includes

A command provider configured to provide a command corresponding to the recognition result in response to a query from the receiving apparatus; and

the 3 rd information processing apparatus includes

An application provider configured to provide an application program corresponding to the command in response to a query from the receiving apparatus.

Claims

1. A receiving device, comprising:

a receiver configured to receive AV content;

An identification result acquirer configured to acquire an identification result of the AV content identified from the extracted features by using ACR (Automatic Content Recognition, automatic content recognition) technology;

a command acquirer configured to acquire a command for controlling the operation of an application program that runs in conjunction with the AV content according to the acquired recognition result; and

A controller configured to control the operation of the application program according to the obtained command.

2. The receiving apparatus according to claim 1, wherein,

said command represents any one of acquiring or registering, acquiring or activating, event raising, interrupting, or stopping of said application; and

The controller controls acquisition or registration, acquisition or activation of the application program, or event initiation, interruption, or stop of the application program in operation according to respective commands.

3. The receiving apparatus according to claim 2, wherein,

include time information in the command indicating when the command was executed; and

The controller executes the command according to the time information.

4. The receiving apparatus according to claim 3, wherein,

The time information is information for executing the command at a preset specific time irrespective of the progress of the AV content, or for when the preset specific time elapses in conjunction with the progress of the AV content. Information about executing commands.

5. The receiving apparatus according to claim 3, wherein,

If the command indicates acquisition or activation, and the application program is not acquired, the controller acquires the application program, and then activates the acquired application program when it is time to execute the command.

6. The receiving apparatus according to claim 1, wherein,

The feature extractor extracts features from one or both of the video signal and the audio signal of the AV content.

7. The receiving apparatus according to claim 1, wherein,

The controller obtains the application program from an application server.

8. A receiving method, comprising the following steps performed by a receiving device:

Receive AV content;

extracting features from the received data of the AV content;

acquiring a recognition result of the AV content recognized from the extracted features by using an ACR technique;

acquiring a command for controlling an operation of an application running in conjunction with the AV content based on the acquired recognition result; and

According to the obtained command, the operation of the application program is controlled.

9. The receiving method according to claim 8, comprising

The application program is acquired from an application server.

10. An information processing system comprising a receiving device, a first information processing device, a second information processing device, and a third information processing device,

in,

The receiving device includes

a receiver configured to receive AV content;

The recognition result acquirer is configured to send the extracted feature to the first information processing device, and obtain the feature obtained from the first information processing device by using ACR (Automatic Content Recognition, automatic content recognition) technology. an identification result of said AV content identified in the feature;

a command obtainer configured to transmit the recognition result obtained from the first information processing device to the second information processing device, and obtain a command corresponding to the obtained recognition result from the second information processing device , a command for controlling the operation of an application running in conjunction with the AV content; and

a controller configured to control the operation of the application program acquired from the third information processing apparatus according to the command acquired from the second information processing apparatus,

The first information processing device includes

a content identifier configured to identify said AV content from said characteristics by using ACR techniques in response to a query from said receiving device;

The second information processing device includes

a command provider configured to provide a command corresponding to the recognition result in response to an inquiry from the receiving device; and

The third information processing device includes

An application provider configured to provide an application program corresponding to the command in response to an inquiry from the receiving device.