US2025094372A1PendingUtilityA1

Computing system for determining resource to perform operation on data and operating method thereof

Assignee: SK HYNIX INCPriority: Jul 15, 2022Filed: Nov 28, 2024Published: Mar 20, 2025
Est. expiryJul 15, 2042(~15.9 yrs left)· nominal 20-yr term from priority
Inventors:Joon Seop Sim
G06F 3/0604G06F 3/067G06F 3/0659G06F 12/0646G06F 3/0635G06F 3/0631G06F 13/28G06F 3/0658
74
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

The present disclosure relates to a computing system. The computing system may include a memory system including a plurality of memory devices configured to store raw data and a near data processor (NDP) configured to receive the raw data by a first bandwidth from the plurality of memory devices and generate intermediate data by performing a first operation on the raw data, and a host device coupled to the memory system by a second bandwidth and determining a resource to perform a second operation on the intermediate data based on a bandwidth ratio and a data size ratio.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A memory system comprising:
 a plurality of memory devices configured to store raw data; and   at least one processor configured to:   receive the raw data by a first bandwidth from the plurality of memory devices,   receive a request to process the raw data by a second bandwidth from a host, and   transmit, in response to the request, one of intermediate data generated by performing a first operation on the raw data or final data generated by performing a second operation on the intermediate data to the host based on a bandwidth ratio and a data size ratio,   wherein the bandwidth ratio is a ratio of the second bandwidth to the first bandwidth, and   wherein the data size ratio is a ratio of a size of the final data to a size of the raw data.   
     
     
         2 . The memory system of  claim 1 , wherein when the bandwidth ratio is greater than the data size ratio, the at least one processor generates the intermediate data and transmit the intermediate data to the host. 
     
     
         3 . The memory system of  claim 2 , wherein the final data is generated by performing the second operation on the intermediate data by the host. 
     
     
         4 . The memory system of  claim 1 , wherein when the bandwidth ratio is smaller than or equal to the data size ratio, the at least one processor generates the final data and transmits the final data to the host. 
     
     
         5 . The memory system of  claim 1 , wherein the at least one processor is further configured to receive a notification indicating that a reception of the intermediate data or the final data has been completed from the host. 
     
     
         6 . The memory system of  claim 1 , wherein the request is generated by the host based on a result of comparing the bandwidth ratio with the data size ratio. 
     
     
         7 . The memory system of  claim 1 , wherein the at least one processor comprises:
 a memory controller configured to control the plurality of memory devices to perform a memory operation including a read operation, an erase operation, and a program operation; and   at least one processor core configured to perform a processing operation including the first operation and the second operation.   
     
     
         8 . The memory system of  claim 7 , wherein the processing operation is configured as at least one or more of a pulling operation, a vector multiplication, a vector sum and a matrix multiplication. 
     
     
         9 . A method of operating a memory system including a plurality of memory devices, the method comprising:
 receiving a raw data by a first bandwidth from the plurality of memory devices;   receiving a request to process the raw data by a second bandwidth from a host; and   transmitting, in response to the request, one of intermediate data generated by performing a first operation on the raw data or final data generated by performing a second operation on the intermediate data to the host based on a bandwidth ratio and a data size ratio,   wherein the bandwidth ratio is a ratio of the second bandwidth to the first bandwidth, and   wherein the data size ratio is a ratio of a size of the final data to a size of the raw data.   
     
     
         10 . The method of  claim 9 , wherein the transmitting the one of the intermediate data or the final data comprises, in response to the bandwidth ratio is greater than the data size ratio, generating the intermediate data and transmit the intermediate data to the host. 
     
     
         11 . The method of  claim 10 , wherein the final data is generated by performing the second operation on the intermediate data by the host. 
     
     
         12 . The method of  claim 9 , wherein the transmitting the one of the intermediate data or the final data comprises, in response to the bandwidth ratio is smaller than or equal to the data size ratio, generating the final data and transmits the final data to the host. 
     
     
         13 . The method of  claim 9 , further comprising receiving a notification indicating that a reception of the intermediate data or the final data has been completed from the host. 
     
     
         14 . The method of  claim 9 , wherein the request is generated by the host based on a result of comparing the bandwidth ratio with the data size ratio. 
     
     
         15 . The method of  claim 9 , wherein each of the first operation and the second operation is configured as at least one or more of a pulling operation, a vector multiplication, a vector sum and a matrix multiplication.

Join the waitlist — get patent alerts

Track US2025094372A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.