XSEDE is now accepting Research Allocation Requests for the allocation period, April 1, 2019 to March 31, 2020. The submission period is from December 15, 2018 thru January 15, 2019. Please review the new XSEDE systems and important policy changes (see below) before you submit your allocation request through the XSEDE User Portal
Important: A recent change to the submission of proposals is that the Allocations proposal submission system(XRAS) will force submissions to disclose access to other compute resources, more information can be found at https://portal.xsede.org/allocations/policies#73
New Resources available:
PSC's Bridges-AI balances maximum capability and capacity, supporting the most complex deep-learning models with the highest accuracy and incorporating the largest data sets. Bridges-AI will make those transformative resources available—at no cost—to researchers across the country. The new resource, delivered by Hewlett Packard Enterprise (HPE), will add an NVIDIA DGX-2 enterprise AI research system and nine HPE Apollo 6500 Gen10 servers. The NVIDIA DGX-2 tightly integrates 16 NVIDIA Tesla “Volta” GPUs – the most powerful GPUs in the world—using the world’s highest-bandwidth on-node switch, the NVSwitch. When used as a single processing unit, the DGX-2 provides 2 petaflops of peak performance, 1,000 times faster than a high-end laptop.
The NVIDIA DGX-2 has about 107 times as many GPU “CUDA cores” and 128 times as much GPU memory as a high-end laptop. The HPE Apollo 6500 servers each have eight “Volta” GPUs internally connected by NVIDIA’s NVLink 2.0, providing substantial capacity to run many models concurrently. While Bridges-AI is primarily focused on AI, its GPUs can also accelerate certain other important applications. Bridges-AI will make possible research that cannot be done on other platforms, and it will allow other research to proceed up to 100 times faster than on users’ local computers.
Bridges-AI is integrated with the existing Bridges system, providing a total of 17 petabytes of data storage, 29,036 CPU cores, 216 GPUs, 277 terabytes aggregate memory, and individual nodes with up to 12 terabytes of memory.
More information about this resource can be found at: https://www.psc.edu/bridges/user-guide
Estimated Available Service Units/GB for upcoming meeting:
Indiana University/TACC (Jetstream) 8,000,000
Open Science Grid (OSG) 2,000,000
PSC Bridges(Regular Memory) 44,000,000
PSC Bridges (Large Memory) 700,000
PSC Bridges (Bridges GPU) 400,000
PSC Bridges (Bridges GPU-AI) 160,000
PSC Persistent disk storage (Pylon) 100,000
SDSC Dell Cluster with Intel Haswell Processors (Comet) 80,000,00
SDSC Dell Cluster with Intel Haswell Processors (Comet GPU) 800,000
SDSC Medium-term disk storage (Data Oasis) 300,000
TACC Dell/Intel Knight's Landing System (Stampede2) 11,000,000 node hours
TACC Data Analytics System (Wrangler) 180,000 node hours
TACC Long-term Storage (Wrangler Storage) 500,000
TACC Long-term tape Archival Storage (Ranch) 2,000,000
Allocation Request Procedures:
In the past code performance and scaling was to be a section addressed in all research requests main document, this section seems to have been overlooked by many PIs in the recent quarterly research submission periods which has led to severe reductions or even complete rejection of both new and renewal requests. Continuing this quarterly submission period it will be mandatory to upload a scaling and code performance document detailing your code efficiency. Please see section 7.2 Review Criteria, of the Allocations Policy document (https://portal.xsede.org/allocations/research#examples).
The XRAC review panel has asked that the PIs include the following: "The description of the computational methods must include explicit specification of the integration time step value, if relevant (e.g. Molecular Dynamics Simulations). If these details are not provided a 1 femtosecond (1fs) will be assumed with this information being used accordingly to evaluate the proposed computations."
All funding used to support the Research Plan of an XRAC Research Request must be reported in the Supporting Grants form in the XRAS submission. Reviewers use this information to assess whether the PI has enough support to accomplish the Research Plan, analyze data, prepare publications, etc.
Publications that have resulted from the use of XSEDE resources should be entered into your XSEDE portal profile which you will be able to attach to your Research submission. Please cite XSEDE in all publications that utilized XSEDE resources. See https://www.xsede.org/for-users/acknowledgement https://www.xsede.org/for-users/acknowledgement
Also note that it is expected that the scaling and code performance information is from the resource(s) being requested in the research request.
Allocations Policy document(https://portal.xsede.org/allocations/policies)
Storage allocation requests for Archival Storage in conjunction with compute and visualization resources and/or Stand Alone Storage need to be requested explicitly both in your proposal (research proposals) and also in the resource section of XRAS.
Furthermore, the PI must describe the peer-reviewed science goal that the resource award will facilitate. These goals must match or be sub-goals of those described in the listed funding award for that year.
After the Panel Discussion of the XRAC meeting, the total Recommended Allocation is determined and compared to the total Available Allocation across all resources. Transfers of allocations may be made for projects that are more suitable for execution on other resources; transfers may also be made for projects that can take advantage of other resources, hence balancing the load. When the total Recommended considerably exceeds Available Allocations a reconciliation process adjusts all Recommended Allocations to remove over-subscription. This adjustment process reduces large allocations more than small ones and gives preference to NSF-funded projects or project portions. Under the direction of NSF, additional adjustments may be made to achieve a balanced portfolio of awards to diverse communities, geographic areas, and scientific domains.
Conflict of Interest (COI) policy will be strictly enforced for large proposals. For small requests, the PI/reviewer may participate in the respective meeting, but leave the room during the discussion of their proposal.
XRAC proposals for allocations request resources that represent a significant investment of the National Science Foundation. The XRAC review process therefore strives to be as rigorous as for equivalent NSF proposals.
The actual availability of resources is not considered in the review. Only the merit of the proposal is. Necessary reductions due to insufficient resources will be made after the merit review, under NSF guidelines, as described in Section 6.4.1.
10% max advance on all research requests, as described in Section 3.5.4
Examples of well-written proposals:
For more information about writing a successful research proposal as well as examples of successful research allocation requests please see: (https://portal.xsede.org/allocations/research#examples)
If you would like to discuss your plans for submitting a research request please send email to the XSEDE Help Desk at email@example.com. Your questions will be forwarded to the appropriate XSEDE Staff for their assistance.
XSEDE Resource Allocations Manager
This message was generated by XSEDE User News v3.0. You can view this message in the XSEDE User Portal at https://portal.xsede.org/web/xup/user-news/-/news/item/10240.