Research Web Based Data Solution

An academic institution in New York is seeking a vendor to provide a comprehensive web-based data solution tailored for research and instructional purposes. The platform must feature high-performance computing capabilities with access to robust servers offering substantial processing power. High-speed, low-latency data access is required to ensure efficient querying, data extraction, and integration for big-data research applications.

The solution should include secure, dedicated user storage directories for programs and output data, along with large temporary and scratch disk space to accommodate intermediate computations. It must support multi-user environments and concurrent job processing while maintaining performance standards. Rigorous data security and compliance measures, such as user authentication, access controls, encrypted connections, and secure data storage, are essential requirements.

Reliability is a priority, with the vendor expected to ensure high system uptime through regular maintenance, backups, and minimal downtime. The system must handle very large, structured and unstructured datasets—including high-volume tables, time-series, and panel data—and support interoperability for integrating and merging data across various sources and formats. Additional specifications include performance optimization through efficient job scheduling and workload management, user-friendly interfaces for both novice and advanced users, capabilities for secure data export and archiving, and tools that support reproducible research workflows including version control compatibility.