dnrops
/
cutlass
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
cutlass/docs/namespacecutlass_1_1device_...

435 lines
19 KiB
HTML
Raw Permalink Normal View History

CUTLASS 2.0 (#62) CUTLASS 2.0 Substantially refactored for - Better performance, particularly for native Turing Tensor Cores - Robust and durable templates spanning the design space - Encapsulated functionality embodying modern C++11 programming techniques - Optimized containers and data types for efficient, generic, portable device code Updates to: - Quick start guide - Documentation - Utilities - CUTLASS Profiler Native Turing Tensor Cores - Efficient GEMM kernels targeting Turing Tensor Cores - Mixed-precision floating point, 8-bit integer, 4-bit integer, and binarized operands Coverage of existing CUTLASS functionality: - GEMM kernels targeting CUDA and Tensor Cores in NVIDIA GPUs - Volta Tensor Cores through native mma.sync and through WMMA API - Optimizations such as parallel reductions, threadblock rasterization, and intra-threadblock reductions - Batched GEMM operations - Complex-valued GEMMs Note: this commit and all that follow require a host compiler supporting C++11 or greater.
2019-11-20 08:55:34 +08:00
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/xhtml;charset=UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=9"/>
<meta name="generator" content="Doxygen 1.8.11"/>
<title>CUTLASS: cutlass::device_memory Namespace Reference</title>
<link href="tabs.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="jquery.js"></script>
<script type="text/javascript" src="dynsections.js"></script>
<link href="search/search.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="search/searchdata.js"></script>
<script type="text/javascript" src="search/search.js"></script>
<script type="text/javascript">
$(document).ready(function() { init_search(); });
</script>
<script type="text/x-mathjax-config">
MathJax.Hub.Config({
extensions: ["tex2jax.js"],
jax: ["input/TeX","output/HTML-CSS"],
});
</script><script type="text/javascript" src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
<link href="doxygen.css" rel="stylesheet" type="text/css" />
</head>
<body>
<div id="top"><!-- do not remove this div, it is closed by doxygen! -->
<div id="titlearea">
<table cellspacing="0" cellpadding="0">
<tbody>
<tr style="height: 56px;">
<td id="projectlogo"><img alt="Logo" src="cutlass-logo-small.png"/></td>
<td id="projectalign" style="padding-left: 0.5em;">
<div id="projectname">CUTLASS
</div>
<div id="projectbrief">CUDA Templates for Linear Algebra Subroutines and Solvers</div>
</td>
</tr>
</tbody>
</table>
</div>
<!-- end header part -->
<!-- Generated by Doxygen 1.8.11 -->
<script type="text/javascript">
var searchBox = new SearchBox("searchBox", "search",false,'Search');
</script>
<div id="navrow1" class="tabs">
<ul class="tablist">
<li><a href="index.html"><span>Main&#160;Page</span></a></li>
<li><a href="modules.html"><span>Modules</span></a></li>
<li class="current"><a href="namespaces.html"><span>Namespaces</span></a></li>
<li><a href="annotated.html"><span>Classes</span></a></li>
<li><a href="files.html"><span>Files</span></a></li>
<li>
<div id="MSearchBox" class="MSearchBoxInactive">
<span class="left">
<img id="MSearchSelect" src="search/mag_sel.png"
onmouseover="return searchBox.OnSearchSelectShow()"
onmouseout="return searchBox.OnSearchSelectHide()"
alt=""/>
<input type="text" id="MSearchField" value="Search" accesskey="S"
onfocus="searchBox.OnSearchFieldFocus(true)"
onblur="searchBox.OnSearchFieldFocus(false)"
onkeyup="searchBox.OnSearchFieldChange(event)"/>
</span><span class="right">
<a id="MSearchClose" href="javascript:searchBox.CloseResultsWindow()"><img id="MSearchCloseImg" border="0" src="search/close.png" alt=""/></a>
</span>
</div>
</li>
</ul>
</div>
<div id="navrow2" class="tabs2">
<ul class="tablist">
<li><a href="namespaces.html"><span>Namespace&#160;List</span></a></li>
<li><a href="namespacemembers.html"><span>Namespace&#160;Members</span></a></li>
</ul>
</div>
<!-- window showing the filter options -->
<div id="MSearchSelectWindow"
onmouseover="return searchBox.OnSearchSelectShow()"
onmouseout="return searchBox.OnSearchSelectHide()"
onkeydown="return searchBox.OnSearchSelectKey(event)">
</div>
<!-- iframe showing the search results (closed by default) -->
<div id="MSearchResultsWindow">
<iframe src="javascript:void(0)" frameborder="0"
name="MSearchResults" id="MSearchResults">
</iframe>
</div>
<div id="nav-path" class="navpath">
<ul>
<li class="navelem"><a class="el" href="namespacecutlass.html">cutlass</a></li><li class="navelem"><a class="el" href="namespacecutlass_1_1device__memory.html">device_memory</a></li> </ul>
</div>
</div><!-- top -->
<div class="header">
<div class="summary">
<a href="#nested-classes">Classes</a> &#124;
<a href="#func-members">Functions</a> </div>
<div class="headertitle">
<div class="title">cutlass::device_memory Namespace Reference</div> </div>
</div><!--header-->
<div class="contents">
<table class="memberdecls">
<tr class="heading"><td colspan="2"><h2 class="groupheader"><a name="nested-classes"></a>
Classes</h2></td></tr>
<tr class="memitem:"><td class="memItemLeft" align="right" valign="top">struct &#160;</td><td class="memItemRight" valign="bottom"><a class="el" href="structcutlass_1_1device__memory_1_1allocation.html">allocation</a></td></tr>
<tr class="memdesc:"><td class="mdescLeft">&#160;</td><td class="mdescRight">Device allocation abstraction that tracks size and capacity. <a href="structcutlass_1_1device__memory_1_1allocation.html#details">More...</a><br /></td></tr>
<tr class="separator:"><td class="memSeparator" colspan="2">&#160;</td></tr>
</table><table class="memberdecls">
<tr class="heading"><td colspan="2"><h2 class="groupheader"><a name="func-members"></a>
Functions</h2></td></tr>
<tr class="memitem:a345678796dcc23b33b4288e26c9b029f"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:a345678796dcc23b33b4288e26c9b029f"><td class="memTemplItemLeft" align="right" valign="top">T *&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a345678796dcc23b33b4288e26c9b029f">allocate</a> (size_t count=1)</td></tr>
<tr class="memdesc:a345678796dcc23b33b4288e26c9b029f"><td class="mdescLeft">&#160;</td><td class="mdescRight">Allocate a buffer of <code>count</code> elements of type <code>T</code> on the current CUDA device. <a href="#a345678796dcc23b33b4288e26c9b029f">More...</a><br /></td></tr>
<tr class="separator:a345678796dcc23b33b4288e26c9b029f"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:ae1978e48f195a60ad01e94815b35bdac"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:ae1978e48f195a60ad01e94815b35bdac"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#ae1978e48f195a60ad01e94815b35bdac">free</a> (T *ptr)</td></tr>
<tr class="memdesc:ae1978e48f195a60ad01e94815b35bdac"><td class="mdescLeft">&#160;</td><td class="mdescRight">Free the buffer pointed to by <code>ptr</code>. <a href="#ae1978e48f195a60ad01e94815b35bdac">More...</a><br /></td></tr>
<tr class="separator:ae1978e48f195a60ad01e94815b35bdac"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:a117e201964852b2b3e228d81eaf73f93"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:a117e201964852b2b3e228d81eaf73f93"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a117e201964852b2b3e228d81eaf73f93">copy</a> (T *dst, T const *src, size_t count, cudaMemcpyKind kind)</td></tr>
<tr class="separator:a117e201964852b2b3e228d81eaf73f93"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:adce1a75429c0eae9d34dc18944777325"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:adce1a75429c0eae9d34dc18944777325"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#adce1a75429c0eae9d34dc18944777325">copy_to_device</a> (T *dst, T const *src, size_t count=1)</td></tr>
<tr class="separator:adce1a75429c0eae9d34dc18944777325"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:a5333f291105136d2e8e4c31329d93c31"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:a5333f291105136d2e8e4c31329d93c31"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a5333f291105136d2e8e4c31329d93c31">copy_to_host</a> (T *dst, T const *src, size_t count=1)</td></tr>
<tr class="separator:a5333f291105136d2e8e4c31329d93c31"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:a8ff6151b081442db9af7421110c0242b"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:a8ff6151b081442db9af7421110c0242b"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a8ff6151b081442db9af7421110c0242b">copy_device_to_device</a> (T *dst, T const *src, size_t count=1)</td></tr>
<tr class="separator:a8ff6151b081442db9af7421110c0242b"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:a0a3ab26e6c9a8aae6b09bfb3e4eb24e8"><td class="memTemplParams" colspan="2">template&lt;typename T &gt; </td></tr>
<tr class="memitem:a0a3ab26e6c9a8aae6b09bfb3e4eb24e8"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a0a3ab26e6c9a8aae6b09bfb3e4eb24e8">copy_host_to_host</a> (T *dst, T const *src, size_t count=1)</td></tr>
<tr class="separator:a0a3ab26e6c9a8aae6b09bfb3e4eb24e8"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:a72db7a89f91c55a23a3cb51e48951709"><td class="memTemplParams" colspan="2">template&lt;typename OutputIterator , typename T &gt; </td></tr>
<tr class="memitem:a72db7a89f91c55a23a3cb51e48951709"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a72db7a89f91c55a23a3cb51e48951709">insert_to_host</a> (OutputIterator begin, OutputIterator end, T const *device_begin)</td></tr>
<tr class="memdesc:a72db7a89f91c55a23a3cb51e48951709"><td class="mdescLeft">&#160;</td><td class="mdescRight">Copies elements from device memory to host-side range. <a href="#a72db7a89f91c55a23a3cb51e48951709">More...</a><br /></td></tr>
<tr class="separator:a72db7a89f91c55a23a3cb51e48951709"><td class="memSeparator" colspan="2">&#160;</td></tr>
<tr class="memitem:a8eec1bf6dd3ff9f8fdb339a9735e6b09"><td class="memTemplParams" colspan="2">template&lt;typename T , typename InputIterator &gt; </td></tr>
<tr class="memitem:a8eec1bf6dd3ff9f8fdb339a9735e6b09"><td class="memTemplItemLeft" align="right" valign="top">void&#160;</td><td class="memTemplItemRight" valign="bottom"><a class="el" href="namespacecutlass_1_1device__memory.html#a8eec1bf6dd3ff9f8fdb339a9735e6b09">insert_to_device</a> (T *device_begin, InputIterator begin, InputIterator end)</td></tr>
<tr class="memdesc:a8eec1bf6dd3ff9f8fdb339a9735e6b09"><td class="mdescLeft">&#160;</td><td class="mdescRight">Copies elements to device memory from host-side range. <a href="#a8eec1bf6dd3ff9f8fdb339a9735e6b09">More...</a><br /></td></tr>
<tr class="separator:a8eec1bf6dd3ff9f8fdb339a9735e6b09"><td class="memSeparator" colspan="2">&#160;</td></tr>
</table>
<h2 class="groupheader">Function Documentation</h2>
<a class="anchor" id="a345678796dcc23b33b4288e26c9b029f"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">T* cutlass::device_memory::allocate </td>
<td>(</td>
<td class="paramtype">size_t&#160;</td>
<td class="paramname"><em>count</em> = <code>1</code></td><td>)</td>
<td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="a117e201964852b2b3e228d81eaf73f93"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::copy </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>dst</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">T const *&#160;</td>
<td class="paramname"><em>src</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">size_t&#160;</td>
<td class="paramname"><em>count</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">cudaMemcpyKind&#160;</td>
<td class="paramname"><em>kind</em>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="a8ff6151b081442db9af7421110c0242b"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::copy_device_to_device </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>dst</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">T const *&#160;</td>
<td class="paramname"><em>src</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">size_t&#160;</td>
<td class="paramname"><em>count</em> = <code>1</code>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="a0a3ab26e6c9a8aae6b09bfb3e4eb24e8"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::copy_host_to_host </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>dst</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">T const *&#160;</td>
<td class="paramname"><em>src</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">size_t&#160;</td>
<td class="paramname"><em>count</em> = <code>1</code>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="adce1a75429c0eae9d34dc18944777325"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::copy_to_device </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>dst</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">T const *&#160;</td>
<td class="paramname"><em>src</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">size_t&#160;</td>
<td class="paramname"><em>count</em> = <code>1</code>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="a5333f291105136d2e8e4c31329d93c31"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::copy_to_host </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>dst</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">T const *&#160;</td>
<td class="paramname"><em>src</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">size_t&#160;</td>
<td class="paramname"><em>count</em> = <code>1</code>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="ae1978e48f195a60ad01e94815b35bdac"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::free </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>ptr</em></td><td>)</td>
<td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="a8eec1bf6dd3ff9f8fdb339a9735e6b09"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename T , typename InputIterator &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::insert_to_device </td>
<td>(</td>
<td class="paramtype">T *&#160;</td>
<td class="paramname"><em>device_begin</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">InputIterator&#160;</td>
<td class="paramname"><em>begin</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">InputIterator&#160;</td>
<td class="paramname"><em>end</em>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
<a class="anchor" id="a72db7a89f91c55a23a3cb51e48951709"></a>
<div class="memitem">
<div class="memproto">
<div class="memtemplate">
template&lt;typename OutputIterator , typename T &gt; </div>
<table class="memname">
<tr>
<td class="memname">void cutlass::device_memory::insert_to_host </td>
<td>(</td>
<td class="paramtype">OutputIterator&#160;</td>
<td class="paramname"><em>begin</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">OutputIterator&#160;</td>
<td class="paramname"><em>end</em>, </td>
</tr>
<tr>
<td class="paramkey"></td>
<td></td>
<td class="paramtype">T const *&#160;</td>
<td class="paramname"><em>device_begin</em>&#160;</td>
</tr>
<tr>
<td></td>
<td>)</td>
<td></td><td></td>
</tr>
</table>
</div><div class="memdoc">
</div>
</div>
</div><!-- contents -->
<!-- start footer part -->
<hr class="footer"/><address class="footer"><small>
Generated by &#160;<a href="http://www.doxygen.org/index.html">
<img class="footer" src="doxygen.png" alt="doxygen"/>
</a> 1.8.11
</small></address>
</body>
</html>