WikiPatents - Community Patent Review
Create Free Account  |  License or Sell Your Patent  |  WikiPatents Marketplace  |  WikiPatents Blog
Username:  Password:  
    
Advanced Search
Transfer controller with hub and ports architecture    
United States Patent6496740   
Link to this pagehttp://www.wikipatents.com/6496740.html
Inventor(s)Robertson; Iain (Cople, GB); Hoyle; David (Bedford, TX)
AbstractThe transfer controller with hub and ports (TCHP) performs the task of communication throughout an entire system in a centralized function. A single hub (435) tied to multiple ports (440, 447, 450, 452) by a central pipeline is the medium for all data communications among DSP clusters (455), external devices, and external memory. A transfer request queue manager (420) receives, prioritizes and queues data transfer requests. Each data port includes an identically configured interior interface (901) connected to the hub (435) and an exterior interface (902) configured for a target external memory/device connected to the port. The interior interfaces of all ports are clocked at a common internal frequency, while the exterior interfaces are clocked at the frequency of the external memory/device connected to the port.



 Title Information Submit all comments and votes
 
Patent Text Patent PDF Print Page Summary File History
Plain text PDF images Print Summary File History
Inventor     Robertson; Iain (Cople, GB); Hoyle; David (Bedford, TX)
Owner/Assignee     Texas Instruments Incorporated (Dallas, TX)
Patent assignment
All assignments
Publication Date     December 17, 2002
Application Number     09/543,870
PAIR File History     Application Data   Transaction History
Image File Wrapper   Patent Term   Fees
Litigation
Filing Date     April 6, 2000
US Classification    
Int'l Classification    
Examiner     Patel; Ramesh
Assistant Examiner    
Attorney/Law Firm     Telecky, Jr.; Frederick J. Brady, III; W. James Marshall; Robert D.
Address
Parent Case    
Priority Data     Apr 21, 1999 [GB] 9909196
USPTO Field of Search    
Patent Tags     transfer controller hub ports architecture
   
Enter a comma (,) or semicolon (;) between multiple tag words/phrases.
Describe this patent:
 Amusing   
 Clever   
 Complex   
 Efficient   
 Historic   
 Important   
 Innovative   
 Interesting   
 Practical   
 Simple   
[no votes]
Patent WIKI

Share information and news about this patent, including information and news about the technology, inventors, company, ligation and licensing.

 References Submit all comments and votes
 
*references marked with an asterisk below are user-added references
 U.S. References
 
Add a new US reference:  
ReferenceRelevancyCommentsReferenceRelevancyComments
6272564
Garrett
710/33
Aug,2001

[0 after 0 votes]
6260099
Gilbertson
710/240
Jul,2001

[0 after 0 votes]
6253260
Beardsley
710/5
Jun,2001

[0 after 0 votes]
6240458
Gilbertson
709/232
May,2001

[0 after 0 votes]
6195724
Stracovsky
710/244
Feb,2001

[0 after 0 votes]
6092173
Sasaki

Jul,2000

[0 after 0 votes]
5812873
Ryu

Sep,1998

[0 after 0 votes]
5748945
Ng
703/23
May,1998

[0 after 0 votes]
5678064
Kulik

Oct,1997

[0 after 0 votes]
5634076
Garde
710/22
May,1997

[0 after 0 votes]
5404522
Carmon
718/107
Apr,1995

[0 after 0 votes]
5379320
Fernandes
375/141
Jan,1995

[0 after 0 votes]
4979170
Gilhousen
370/321
Dec,1990

[0 after 0 votes]
 Foreign References
 Other References
 Market Review Submit all comments and votes
   
Market Size
Estimate the gross annual revenues of the relevant market sector:
> $10B
$5B - $10B
$2B - $5B
$500M - $2B
$100M - $500M
$10M - $100M
$1M - $10M
$500K - $1M
$100K - $500K
< $100K
[No votes]
$0
 
$0   $2.5B   $5B   $7.5B   $10B
Market Share
Estimate the percentage of the relevant market sector this invention will capture:
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Reasonable Royalty
What percentage of gross sales should the inventor or assignee be paid?
75% - 100%
50% - 74.99%
25% - 49.99%
10 - 24.99%
5 - 9.99%
2 - 4.99%
1 - 1.99%
< 1%
[No votes]
0.0%
 
0%   25%   50%   75%   100%
Public's "Guesstimation" of Royalty Value
Market SizeN/A[No votes]
xMarket ShareN/A[No votes]
xReasonable RoyaltyN/A[No votes]

N/A

License Availablity
If you are NOT the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
License Availablity
If you ARE the owner or assignee, answer here:
Yes, license is available for purchase

No, license is not currently available



[No votes]
Competitive Advantage
Does this invention have a significant competitive advantage over similar technologies?
Yes

No



[No votes]
Most helpful competitive advantage comment
[No comments]

Commercial Alternatives
Are there viable commercial alternatives for this invention?
Yes

No



[No votes]
Most helpful commercial alternative comment
[No comments]

 Technical Review Submit all comments and votes
 Claims Submit all comments and votes
 


What we claim is:

1. A data transfer controller comprising. a request queue controller capable of receiving, prioritizing and dispatching data transfer requests each specifying a data source, a data destination and a data quantity to be transferred; a data transfer hub connected to the request queue controller for receiving dispatched data transfer requests; a plurality of ports, each port having an interior interface connected to the data transfer hub which is the same for each port and an exterior interface configured for an external memory/device which, in operation, is connected to said port, the interior interface and the exterior interface being connected for data transfer therebetween; and the data transfer hub being capable of controlling data transfers from a source port corresponding to the data source to a destination port corresponding to the data destination in quantities corresponding to the data quantities to be transferred under a currently executing data transfer request.

2. The data transfer controller of claim 1, wherein: said data transfer hub and said interior interface of each of said plurality ports are clocked at first common frequency; said exterior interface of each of said plurality of ports is clocked at a second frequency corresponding to external memory/device expected to be connected to said port, said second frequency of at least one of said plurality of ports being asynchronous with said first common frequency.

3. The data transfer controller of claim 1, wherein: said data transfer hub includes a plurality of data channels, each data channel having a source address calculation unit, a destination address calculation unit and a data first-in-first-out buffer, said data transfer hub controlling reading of data by supply of a source address calculated by said source address calculation unit to said source port and supplying data read from said source port to an input of said data first-in-first-out buffer, and writing of data by supply of a destination address calculated by said destination address calculation unit to said destination port and supplying data to be written to said destination port from an output of said data first-in-first-out buffer.

4. The data transfer controller of claim 3, wherein: said data transfer request specifies a data source by specifying a source base address, a source interval and a source word count; and said source address calculation unit includes a source base address register initially loaded with said source base address, a source interval address register initially loaded with said source interval, a source word count register initially loaded with said source word count, a source address adder connected to said source base address register and said source interval address register, said source address adder calculating a next source address by adding data stored in said source base address register to data stored in said source interval address register and storing said next source address in said source base address register, and a source word count decrementer connected to said source word count register decrementing said word count stored in said source word count register for each calculated next source address, said data transfer hub ending data transfer in response to a data transfer request when said source word count stored in said source word count register has decremented to zero.

5. The data transfer controller of claim 3, wherein: said data transfer request specifies a data destination by specifying a destination base address, a destination interval and a destination word count; and said destination address calculation unit includes a destination base address register initially loaded with said destination base address, a destination interval address register initially loaded with said destination interval, a destination word count register initially loaded with said destination word count, a destination address adder connected to said destination base address register and said destination interval address register, said destination address adder calculating a next destination address by adding data stored in said destination base address register to data stored in said destination interval address register and storing said next destination address in said destination base address register, and a destination word count decrementer connected to said destination word count register decrementing said word count stored in said destination word count register for each calculated next destination address, said data transfer hub ending data transfer in response to a data transfer request when said destination word count stored in said destination word count register has decremented to zero.

6. The data transfer controller of claim 1, wherein: said data transfer hub includes a plurality of data channels, each data channel having a source address calculation unit, a destination address calculation unit and a data first-in-first-out buffer, said data transfer hub controlling reading of data by supply of a source address calculated by said source address calculation unit to said source port and supplying data read from said source port to an input of said data first-in-first-out buffer, writing of data by supply of a destination address calculated by said destination address calculation unit to said destination port and supplying data to be written to said destination port from an output of said data first-in-first-out buffer until said data quantity specified in said data transfer request has been transferred, whereupon said data channel is open; said data transfer requests each have a priority within a hierarchy of priorities; said request queue controller dispatching data transfer requests to an open data channel of said data transfer hub in priority order from highest to lowest priority within said hierarchy of priorities and within each priority level from a first received data request to a last received data transfer request.

7. The data transfer controller of claim 6, wherein: said data transfer hub controlling a data transfer request until said data transfer request completes or generates a fault once assigned to a data channel.

8. The data transfer controller of claim 6, wherein: said request queue controller includes a request queue memory storing data transfer requests upon receipt prior to dispatch, said request queue memory having a data capacity to store more data transfer requests than a number of data channels of said data transfer hub.

9. A data processing system comprising: a plurality of data processors, each data processor being capable of generating a data transfer request; a request queue controller connected to the plurality of data processors for receiving, prioritizing and dispatching data transfer requests each specifying a data source, a data destination and a data quantity to be transferred; a data transfer hub connected to the request queue controller for receiving dispatched data transfer requests; a plurality of ports, each port having an interior interface connected to said data transfer hub which is the same for each port and an exterior interface configured for an external memory/device which in operation is connected to the port, the interior interface and said exterior interface being connected for data transfer therebetween; and the data transfer hub being capable of controlling data transfers from a source port corresponding to the data source to a destination port corresponding to the data destination in quantities corresponding to the data quantities to be transferred under a currently executing data transfer request.

10. The data processing system of claim 9, wherein: each of said data processors, said data transfer hub and said interior interface of each of said plurality ports are clocked at first common frequency; said exterior interface of each of said plurality of ports is clocked at a second frequency corresponding to external memory/device expected to be connected to said port, said second frequency of at least one of said plurality of ports being asynchronous with said first common frequency.

11. The data processing system of claim 9, further comprising: a system memory connected to a predetermined one of said plurality of ports; and wherein each of said data processors includes a program cache for temporarily storing program instructions controlling said data processor, said data processor generating a data transfer for program cache fill from said system memory upon a read access miss to said program cache.

12. The data processing system of claim 9, further comprising: a system memory connected to a predetermined one of said plurality of ports; and wherein each of said data processors includes a data cache for temporarily storing data employed by said data processor, said data processor generating a data transfer for data cache fill from said system memory upon a read access miss to said data cache.

13. The data processing system of claim 9, further comprising: a system memory connected to a predetermined one of said plurality of ports; and wherein each of said data processors includes a data cache for temporarily storing program instructions, said data processor generating a data transfer for data writeback to said system memory upon a write miss to said data cache.
 Description Submit all comments and votes
 


This application claims priority under 35 USC .sctn.119 of British Application Number 99 09196.9, filed Apr. 21, 1999, in the United Kingdom Patent Office.

BACKGROUND OF THE INVENTION

1. Field of the Invention

General purpose multiprocessors, with a few exceptions, generally fall in a class of architectures which have been classified as `multiple instruction stream, multiple data stream processors`, sometimes labeled MIMD multiprocessors. This classification can be further divided into two sub-classes. These are: (1) centralized shared memory architectures illustrated in FIG. 1 and (2) distributed memory architectures illustrated in FIG. 2.

In FIG. 1, the shared main memory functional block 100 may be accessed by any one of the four processors 101, 102, 103, 104 shown. The external memory interface block 105 includes several possible sub-blocks among which are DRAM controller, SRAM controller, SDRAM controller, external disc memory interface, external ROM interface, RAMBus, or synchronous link DRAM interface and all other external memory devices.

The XDMA (external direct memory access) interface 106 is the interface to fully autonomous external devices. The external I/O interface 107 includes all other external interface: fast serial I/O port controller, parallel I/O interface, PCI bus controller, and DMA (direct memory access interface) controller are examples.

In FIG. 2 in distributed memory multi-processor machine, the main memory is distributed among processor nodes 201, 202, 203, 204, 205, 206, and 207 as shown and all external memory interfaces are accomplished through the interconnection network 210. External direct memory access is centralized at the XDMA port 208 which includes the XDMA control and I/O interface functions. Direct memory access (DMA) is distributed at each processor I/O Node or could be centralized as shown in the DMA functional block 209.

Interchange of data in FIG. 2, from one processor node to another and from any processor node to external devices and memory is exceedingly complex and collisions caused by conflicting data transfer requests are frequent.

Systems having perhaps two to four processors might be of either the centralized shared memory type or the distributed memory type, but as the required processor count increases, the advantages of a distributed memory architecture become prominent. This is because a centralized shared memory 100 cannot support the bandwidth requirements of the larger number of processors.

The complexity of the interconnection network required in a distributed memory multiprocessor is one of elements of the cost of surmounting the bandwidth limitations of the shared memory system. Other elements of cost are addressing complexity and additional coherency and protocol requirements. The disadvantage of a distributed memory system is that this complex interconnection network has a formidable task, the communication of data between each and any pair of processors, which results in higher latency than the single, shared memory processor architecture.

Conventional digital signal processors (DSP) having a single processor typically include direct memory access, a method of memory access not requiring CPU activity, and conventionally this is accomplished by a `DMA` functional block, which includes an I/O device and a controller function. This functional feature allows interface of external devices with CPU, internal memory, external memory, and other portions of the chip.

Direct memory access is usually the term used for external device interface, but external DRAM memory could be considered as simply another external device which has more demanding throughput requirements and would operate at a somewhat higher frequency than the typical frequency of a simple I/O device. The DMA interface is the communication link which relieves the central processing unit (CPU) from servicing these external devices on its own, preventing with loss of many CPU cycles which would be consumed in a direct CPU-external device interface.

Digital signal processing (DSP) differs significantly from general purpose (GP) processing performed by micro-controllers and microprocessors. One key difference is the typical strict requirement for real time data processing. For example, in a modem application, it is absolutely required that every sample be processed. Even losing a single data point might cause a DSP application to fail. While processing data samples may still take on the model of tasking and block processing common to general purpose processing, the actual data movement within a DSP system must adhere to the strict real-time requirements of the system.

As a consequence, DSP systems are highly reliant on an integrated and efficient DMA (direct memory access) engine. The DMA controller is responsible for processing transfer requests from peripherals and the DSP itself in real time. All data movement by the DMA must be capable of occurring without central processing unit (CPU) intervention in order to meet the real time requirements of the system. That is, because the CPU may operate in a software tasking model where scheduling of a task is not as tightly controlled as the data streams that the tasks operate on, the DMA engine must sustain the burden of meeting all real time data stream requirements in the system.

There are several approaches that may be taken to meet these requirements. The following is a brief summary of the conventional implementations of DMA engines, and their evolution into the unique I/O solution provided by the present invention, the transfer controller with hub and ports (TCHP) architecture.

2. Description of the Related Art

The conventional DMA engine consists of a simple set of address generators which can perform reads and writes of some, or perhaps all, addresses within a DSP system. The address generation logic is normally implemented as a simple counter mechanism, with a reload capability from a set of DSP memory-mapped registers. A typical use of a DMA controller is for the DSP to load the counters with a starting address and a count, representing the amount of data to transfer. The DSP must supply both the source and destination addresses for the transfer. Once this information has been loaded into the counters, the DSP can start the DMA via a memory mapped register write. The DMA engine then begins performing read and write accesses to move the requested data without further DSP intervention. The DSP is free to begin performing other tasks.

As the DMA performs read and writes to the source and destination locations, the addresses are incremented in each counter while the count is decremented. Once the count reaches zero, the transfer is complete and the DMA terminates. Most DMAs include a mechanism of signaling this `done` state back to the CPU via a status bit or interrupt. In general the interrupt method is preferred because it does not require a polling loop on the DSP to determine the completion status.

The simplest DMAs provide for basic single dimensional linear transfers. More advanced DMA engines may provide multi-dimensionality, indexed addressing, and reverse and fixed addressing modes.

As DSP cores have reached higher and higher performance, applications have opened up which can utilize the increased processing capability. Along with this however, has come the need for higher speed, and higher complexity DMA engines. For example, if a previous generation DSP only had enough processing power for a single audio channel, a single DMA engine might be sufficient. However, when a new DSP architecture is introduced with ten times this performance, now multiple channels of audio could be processed. However, the DSP processing alone is not sufficient to provide the additional channel capacity. The DMA must also be enhanced to provide the data movement functions required for the multiple channels.

There are several features which are becoming increasingly common to DMAs which have attempted to address the issue of providing higher performance. The first is the inclusion of more DMA channels. A single DMA channel basically consists of all the hardware required to process a single direct memory access, and will generally include at least a source and destination address register/counter, a byte count register/counter, and the associated control logic to allow it to perform basic read and write operations.

Depending on the addressing modes which the DMA support additional logic may also be required. In a multi-channel DMA, the logic for a single channel is generally just replicated multiple times to provide increased channel capability. In addition to the multiple instantiations of the channels, a multi-channel DMA must also include some arbitration logic to provide time division access by all the channels to the memory/peripherals which the channels can address.

Conventional DMAs include anywhere from 2 to 16 channels. The advantage of additional channels is that each channel can contain parameters for a specific type of transfer. The DSP sets up each channel in advance, and does not have to reload the DMA registers each time a new transfer has to be done, the way it would have to if only a single channel existed.

A second enhancement to conventional DMA engines is the ability for peripherals to start DMAs autonomously. This function is generally provided in a manner analogous to a DSP interrupt. The DSP is still responsible for setting up the DMA parameters initially, however, the channel performs the reads and writes at the request of a peripheral rather than requiring the DSP to start it off. This is particularly advantageous in systems where there are a large number of data streams to process, and it would not be efficient to have the DSP task switching from one stream to the next all the time. This is also a significant advantage when the data streams may be of significantly different types and speeds. Because each DMA channel can be programmed independently, the parameters for each transfer type can be adjusted accordingly.

The final optimization to be noted here, which highly sophisticated conventional DMA controllers can include, is the option of dynamic reloading. This process allows a DMA channel to reload its own parameters from a set of registers without requiring CPU intervention. In some systems, the reload can even occur directly from memory, which can create a highly powerful DMA mechanisms due to the expanded storage capacity. Because the reload values may be set up by the DSP, many complicated DMAs may be effectively linked to one another. That is, the completion of one DMA parameter set forces the reload of another set, which may be of a completely different type than the first.

Through intelligent setup of the parameters, the DMAs can perform many complex functions not directly supported by the DMA hardware. Dynamic reload is once again very important in systems where many data streams are handled via the DMA, as it removes the requirement from the DSP to reload each of the DMA channels.

While DMAs are a powerful tool in a DSP system, they also have their limitations. The fundamental limitation of a conventional DMA engine is that adding additional channel capacity requires additional hardware (in general, a replication of a complete channel). Some optimizations can be made in this area, such as sharing registers between multiple channels, but in general, the following rule holds: N-channels costs N times as much as a single channel.

This basic principle led to the initial development of the Transfer Controller (TC). The TC is a unique mechanism which consolidates the functions of a DMA and other data movement engines in a DSP system (for example, cache controllers) into a single module.

Consolidation of such functions has. both advantages and disadvantages. The most important advantage of consolidation is that it will, in general, save hardware since multiple instantiations of the same type of address generation hardware will not have to be implemented.

On a higher level, it is also advantageous to consolidate address generation since it inherently makes the design simpler to modify from a memory-map point of view. For example, if a peripheral is added or removed from the system, a consolidated module will be the only portion of the design to change. In a distributed address system (multi-channel DMA for example), all instances of the DMA channels would change, as would the DSP memory controllers.

Fundamental disadvantages of the consolidated model are its inherent bottlenecking and challenge to higher clock rates. Additionally, there is in general an added complexity associated with moving to a consolidated address model, just because the single module is larger than any of the individual parts it replaces.

TMS320C80/TMS320C82 Transfer Controller

The first transfer controller (TC) module was developed for the TMS32OC80 DSP from Texas Instruments. This TC is the subject of the following U.S. Pat. No. 5,560,030 entitled `Transfer Processor with Transparency` dated Sep. 24, 1996. This TC consolidated the DMA function of a conventional controller along with the address generation logic required for servicing cache and long distance transfers (this function is referred to as direct external access) from four DSPs and a single RISC (reduced instruction set computer) processor.

The TMS320C80 TC architecture is fundamentally different from a DMA in that only a single set of address generation and parameter registers is required, rather than multiple sets for multiple channels. The single set of registers, however, can be utilized by all DMA requesters. DMA requests were posted to the TC via set of encoded inputs at the periphery of the device. Additionally, each of the DSPs can submit DMA requests to the TC. The external encoded inputs which are `externally initiated packet transfers` are referred to as XPTs, while the DSP initiated transfers are referred to as `packet transfers` PTs. The reduced instruction set computer (RISC) processor could also submit PT requests to the TC.

When a PT (or XPT) request is made to the TC, it is prioritized according to a fixed scheme. XPTs are the highest, since they most often require immediate servicing. Nevertheless, PT service involved the TC reading a fixed location in internal memory to determine the point at which to access the parameters for the transfer. This location is termed the `linked list start address`. Transfer parameters include the basic source and destination addresses, along with byte counts as in a conventional DMA.

However, the TMS320C80 TC was significantly advanced in that it included support for many more transfer modes. These modes totalled over 130 in all, and comprehended up to three dimensions. Options included such features as lookup table transfers, offset guided transfers, walking through memory in an indexed fashion, and reverse mode addressing.

Further enhancements such as parameter swapping between source and destination allowed a single set of parameters to be used for data capture, and then return to the location from which it was originally fetched, a feature found very useful in DSP processing routines. The TMS320C80 TC PT's also supported an infinite amount of linking such that software linked lists of PTs could be generated up to the available memory in the system.

The TMS320C80 TC additionally provided the main memory interface for the device. A single 64-bit datapath external interface was provided, which could talk to SDRAM, DRAM, VRAM, SRAM, and ROM devices. Programmable refresh control for dynamic memory was also provided by the TC. The external interface provided dynamic page and bus sizing, and single cycle throughput. At 60 MHz, up to 480 MB/s burst transfer rates were achievable. In real applications, a sustainable rate of <420 MB/s was possible.

On the internal side of the TMS320C80 TC, access to the multiple DSP node memories was provided via a large crossbar, which included a 64-bit datapath to all on chip memories. Crossbar access was arbitrated in a round-robin fashion between the DSPs, RISC processor, and TC on a cycle-by-cycle basis. All totaled, the internal memory port could support up to 2.9 GB/s of bandwidth.

Because the TMS32OC80 TC included only a single set of PT processing registers, all PTs had to use them. Once a PT had begun, future requests were blocked until that PT was complete. To deal with this `in-order blocking` issue, the TC instituted a mechanism known as suspension, where an active PT could be stopped in favor of something of higher priority, and then automatically restarted once the higher priority transfer completed. Because the TC relied on a memory mapped set of `link list pointers` to manage all PT requests, it was simple for the TC to suspend a transfer by copying the parameters in the TC registers back to that referenced address to perform the suspension. This ability to reuse a single set of registers for all transfers in the system was the single most important difference between the TC and a traditional DMA.

The TMS320C80 TC, despite being very flexible, has a number of deficiencies. The key issue with the architecture are that it was very complex. Over the history of the TMS320C80 TC, the external memory interface changed in four of the five major device revisions. Because the TMS320C80 TC also provided the external memory interface, it was altered significantly from one revision to the next. This inherently opened up new and unknown timing windows with each revision, resulting in a large number of device errata. The internal crossbar was also a key limit to speed.

A final key issue with the TMS320C80 TC was the support of suspension of transfers. This mechanism allowed transfers which were in progress to be halted, their parameters written back to memory, and a new transfer started automatically. While an excellent programming and use model, the process of copying back and rereading parameters was problematic. Many timing windows existed during which transfers needed to be locked out, a virtual impossibility in a real time data streaming system.

SUMMARY OF THE INVENTION

The transfer controller with hub and ports TCHP of this invention is an interconnection network which assumes the task of communication throughout the processor system and its peripherals in a centralized function. Within the TCHP, a system of one hub and multiple ports tied together by a common central pipeline is the medium for all data communications among DSP processor nodes, external devices, and external memory. This includes communication between two or more DSP nodes as the DSP node does not have direct access to the memory of each other DSP node.

FIG. 3 illustrates the basic principal features of the TCHP. The TCHP is basically a data transfer controller which has at its front end portion, a request queue controller 300 receiving, prioritizing, and dispatching data in the form of transfer request packets. The request queue controller 300 connects within the hub unit 310 to the channel registers 320 which receive the data transfer request packets and processes them first by prioritizing them and assigning them to one of the N channels each of which represent a priority level. These channel registers interface with the source 330 and destination 340 pipelines which effectively are address calculation units for source (read) and destination (write) operations.

Outputs from these pipelines are broadcast to M Ports (six shown in FIG. 3 as 350 through 355) which are clocked either at the main processor clock frequency or at a lower external device clock frequency. Read data from one port, e.g. port 350, having a destination write address of port 353 is returned to the hub destination control pipeline through the data router unit 360.

The TCHP can be viewed as a communication hub between the various locations of a global memory map. In some systems having multiple DSP processor nodes, each such node has direct access only to its locally allocated memory map. In the system of this invention, any access outside of a DSPs local space is accomplished exclusively by a TCHP directed data transfer.

The various types of data transfers supported by the TCHP are: 1. Direct Memory Access (DMA): Data Transfer explicitly initiated by a program instruction being executed from a DSP processor node. 2. External Direct Memory Access (XDMA): Data Transfer explicitly initiated by an autonomous external device. 3. Long Distance Transfer: Load/Store operations outside of a DSPs local memory space. 4. Data Cache (DC) Transfer: Data cache miss-fill/writeback request from a DSP processor node. 5. Program Cache (PC) Transfer: Program cache miss-fill request from a DSP processor node.

In summary, the TCHP of this invention is a highly parallel and highly pipelined memory transaction processor, which serves as a backplane to which many peripheral and/or memory ports may be attached. The TCHP provides many features above and beyond existing DMA and XDMA controllers, including support for multiple concurrent accesses, cycle-by cycle arbitration for low turnaround, and separate clocking of all ports asynchronous to the main processor clock.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a central shared memory multi-processor machine (Known Art);

FIG. 2 illustrates a distributed memory multi-processor machine (Known Art);

FIG. 3 illustrates in a functional block diagram the basic principal features of the TCHP of this invention;

FIG. 4 illustrates the transfer controller with hub and ports architecture, the detailed functional block of this invention (TCHP) along with its closely associated functional units, as originally described;

FIG. 5 illustrates the Multi-Processor Machine with Transfer Controller with HUBs and Ports Architecture TCHP functional block of this invention, showing from a higher level, the essential elements of the Transfer Controller TCHP and its associated functional units. The elements of the invention are the queue manager and the TCHP hub. The associated units are the transfer request feed mechanism, the data transfer bus, and the external port interface units;

FIG. 6 illustrates the generic address unit block diagram of the TCHP of this invention, which is used to calculate source/destination addresses, word count and line count within the source/destination pipeline units;

FIG. 7 illustrates the queue manager functional block of this invention, where transfer requests are received, prioritized and placed in a queue;

FIG. 8 illustrates the TCHP of this invention, which contains the queue manager and the hub engine which comprises channel request registers, port parameters registers, channel parameters registers, source and destination pipelines, and routing unit;

FIG. 9 illustrates the TCHP external port interface unit (EPIU) block of this invention, which acts as a buffer between the TCHP hub engine and the memory or peripheral port;

DETAILED DESCRIPTION OF THE INVENTION

The TCHP and its closely associated functional units, may be broken into five main entities (refer to FIG. 4): 1. The request bus master 400 input which takes in transfer request packets from the transfer request feed mechanism 401, these transfer requests originating from processor elements or other devices. These transfer request packets are input to the queue manager 420 which is within the TCHP. A transfer request is a command (in the preferred embodiment the command word is of quad word length or double long word length i.e. approximately 128 bits in length) to the TCHP to move a specified number of data elements from one global address to another. 2. The TCHP, shown within the dashed line of FIG. 4, includes queue manager 420, dual port RAM 425 queue storage, and the hub engine 435 with channel registers 439, source/destination pipelines and routing unit 449. The dashed line disects the external ports interface units, indicating that the THCP proper, terminates within these ports. The hub engine 435 performs the servicing of the transfers, breaking them into smaller transfers that the devices can handle. 3. The internal memory port (IMP) node master 450, which is viewed as a special TCHP port, interfaces to the data transfer bus (DTB) 455 which connects the port representing internal memory to the processor nodes. Processor nodes interfaces here include all distributed internal data memory and internal program memory controllers and to all the other control registers on the processor system. 4. The data transfer bus (DTB) 455, another associated TCHP unit, connects the port representing internal memory to the memory interfaces in the DSP processor nodes and other units in the core of the chip. 5. The external ports interfaces 440 through 447 which act as a buffer between the hub engine and the external memory or peripheral port.

The TCHP of this invention is applicable in general to complex systems whether or not multiple DSP processor nodes are used. The ability to place in queue, data transfer requests from multiple sources and to service them while interfacing with multiple external interfaces, including external memory, with efficient control of priorities, is an added advantage which the transfer controller concept of this invention makes possible. In a general sense, the transfer controller of this invention handles multiple `transfer requesters` whether these be DSP processor nodes, central processor units (CPU) or other generic functional blocks requiring data transfers.

The TCHP of this invention introduces several new ideas supplanting the older TMS320C80 TC philosophy. 1. First, it is uniformly pipelined. In the previous TC designs, the pipeline was heavily coupled to the external memory type that was supported by the device. In the preferred embodiment, the TC contains multiple external ports, all of which look identical to the TC hub, such that peripherals and memory may be freely interchanged without affecting the TC. 2. Secondly, the TCHP now has the concept of concurrent execution of transfers. That is, up to N transfers may occur in parallel on the multiple ports of the device, where N is the number of channels in the TCHP core. Each channel in the TCHP core is functionally just a set of registers, which tracks the current source and destination addresses, as well as word counts and other parameters for the transfer. Each channel is identical, and thus the number of channels supported by the TCHP is highly scaleable. 3. Thirdly, the TCHP includes a mechanism for queuing transfers up in a dedicated queue RAM. In earlier devices of known TC art (e.g. TMS320C80), the rule was one transfer outstanding per processor at a time. Through the queue RAM, processors may issue numerous transfer requests before stalling the DSP. 4. The fourth key element which the new TCHP provides is support for write driven processing. Most DMAs and TMS320C80 style TC designs rely on read driven processing: In read driven processing, in a memory move the read access regulates the operation, since the writes can obviously not occur until read data returns. Likewise, if the destination to which the writes are to be performed is very slow (say a peripheral) in comparison to the source, then the source is held up by the writes. This can be very inefficient, particularly if the source is main memory, which all processors and peripherals rely upon. To maximize use of faster memory ports, the TCHP institutes what is referred to as write driven processing.

The basic TCHP architecture includes two pipelines, referred to as source and destination (SRC and DST) . Each pipeline is functionally identical, in that it contains logic for performing six logical functions. These are:

Pipeline Stage Letter Designation Function Q Interrogates the state of the queues within the ports M Map port ready signals to channels P Prioritize highest priority channel whose ports are ready A0 1/2 Address update cycle A1 2.sup.nd 1/2 Address update cycle C Issue command to ports

The six stages above represent LOGICAL operations which must be performed by each pipeline. The LOGICAL states may be mapped to PHYSICAL pipeline stages in any number of cycles. One early device which utilized the TC concept included 6 PHYSICAL stages, one for each LOGICAL state. Another device included just 3 PHYSICAL stages, allowed by the reduced clock frequency requirement for that device. Other numbers of PHYSICAL stages are allowed as well with no architectural change to the TC. This feature makes the TC HUB highly scaleable to a wide range of frequencies.

The source (SRC) pipeline is responsible for issuing read and pre-write commands. Read commands are straightforward, pre-write commands are used to reserve space in a write reservation station as described above.

The destination (DST) pipeline is responsible for issuing write command only, but also interfaces with a module referred to as the routing unit. Functionally, the routing unit is a fully orthogonal crossbar, connecting all ports to one another. However, unlike normal crossbar, the routing unit is part of the TCHP pipeline,. and thus isnt a speed limitation as it was on the TMS320C80 and other crossbar architectures.

The two pipelines can operate independently of one another, and thus a single read and write command can be issued on every cycle. Commands are issued to the ports in what are referred to as `bursts`. A burst size is determined by the type of memory or peripheral that the port interfaces to. The `default burst size`, or what the TC tries to optimize accesses to, is determined by a tie-off at each port interface. By doing this, the TCHP is isolated from knowing what type of memory or peripheral is attached to each port. Because commands are issued for `bursts` or words at a time (generally, bursts are one to eight 32-bit words in length) and will take multiple peripheral cycles to complete, multiple accesses can be posted to the ports at a time. Each port interface includes buffering to catch landing read data, and buffer outgoing write data while a burst packet is formed.

These buffers physically reside in what are referred to as EPIU, or external port interface units. The EPIUs are physically part of the TCHP, though outside of the pipelines. The EPIU interface to the TC HUB is identical for all ports. The EPIUs in turn provide a uniform interface to the peripherals and memory, such that modules can be developed for a Plug-n-Play interchangeable model. One other function of the EPIU buffers is synchronization. Because the buffers are physically FIFOs, the peripheral side of the EPIU may operate completely asynchronous to the TC hub. In fact, each port in the TCHP may operate asynchronously to one another and to the TC HUB. This feature makes the TCHP highly scaleable, as it is not tied to any one particular memory or peripheral interface, nor is it tied to a specific clock frequency.

Requests are made to the TCHP via a functional device referred to as the transfer request feed mechanism TRFM. This functional device, in accordance with the rest of the TCHP concept,