US2020210241A1PendingUtilityA1

Method and system for gpu virtualization based on container

Assignee: LABLUP INCPriority: Dec 26, 2018Filed: Mar 27, 2019Published: Jul 2, 2020
Est. expiryDec 26, 2038(~12.4 yrs left)· nominal 20-yr term from priority
G06F 9/5077G06F 2009/45562G06T 1/20G06F 9/45558G06F 9/5027G06F 2009/4557G06F 9/54G06F 9/5055
51
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A GPU virtualization method based on a container comprises the steps of: transmitting, if the container is created, a configuration file including GPU resource constraint information and an API profile to the container, by a node controller; and implementing a virtual GPU, when the container is executed, by intercepting a library call and changing an argument related to a GPU resource amount by a library controller provided in the container, and by intercepting a system call and changing argument and return values by a system call controller.

Claims

exact text as granted — not AI-modified
1 . A GPU virtualization method based on a container, the method comprising the steps of:
 transmitting, if the container is created, a configuration file including GPU resource constraint information and an API profile to the container, by a node controller; and   implementing a virtual GPU, when the container is executed, by intercepting a library call and changing an argument related to a GPU resource amount by a library controller provided in the container, and by intercepting a system call and changing argument and return values by a system call controller.   
     
     
         2 . The method according to  claim 1 , wherein the node controller confirms GPU resource availability, initializes resource information of the node controller, reports the resource availability to a manager, receives a job assigned by the manager, and updates resource availability information of the node controller by subtracting the resources as much as a requested amount. 
     
     
         3 . The method according to  claim 2 , wherein the node controller stores the configuration file including resource constraint information in the container when the container is created, and collects the resources as much as a requested amount and updates the resource availability information of the node controller if an end of executing the container is sensed. 
     
     
         4 . The method according to  claim 1 , wherein when a library function call event of a user program is received, the library controller determines whether the event is an API call related to inquiry and allocation of GPU resources, changes at least one among an argument, a structure field and a return value related to GPU resource amounts, and calls an original library function. 
     
     
         5 . The method according to  claim 1 , wherein when a system call event of a user program is received, the system call controller  139  determines whether the event is a system call of at least one among permission, block and change according to a predefined API profile, and changes argument and return values before and after the call of original system call according to rules of the API profile. 
     
     
         6 . A GPU virtualization system based on a container, the system comprising:
 an operating system including a node controller for transferring a configuration file including resource constraint information and a system call/API profile to the container; and   the container configured of a library controller for determining, when a library function call event of a user application is received, whether the event is an API call related to inquiry and allocation of GPU resources, changing at least one among an argument, a structure field and a return value related to GPU resource amounts, and calling an original library function, and a system controller determining, when a system call event of the user program is received, whether the event is a system call of at least one among permission, block and change according to a predefined API profile, and changing argument and return values before and after a call of original system call according to rules of the API profile.

Join the waitlist — get patent alerts

Track US2020210241A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.