0000275: Investigate archival data usage over the last few years
All Projects | CNI | DZB | equalizer | IVC/ADC | LFFE | MFFE | Puma | Puma 2 | RFI | RT | submission | system time | Tadu | Time/LO | TMS | VLBI

Main | My View | View Issues | Change Log | Docs
  

Viewing Issue Simple Details [ Jump to Notes ] [ Issue History ] [ Print ]
ID Category Severity Reproducibility Date Submitted Last Update
0000275 [TMS] minor always 21-06-10 21:41 08-07-10 07:19
Reporter Arno Schoenmakers View Status public  
Assigned To
Priority normal Resolution open  
Status closed  
Summary 0000275: Investigate archival data usage over the last few years
Description Predict amount of data needed per semester, roughly, based on numbers of teh last few years.
Additional Information
Attached Files

- Relationships

- Notes
(0000292)
Arno Schoenmakers
08-07-10 07:19

 Hi,
 
that's a bit over the top, but Teun and I will come up with a suggestion for additional storage.

  Arno

>>> Harm Munk 29-6-2010 10:54 >>>

Hi Josh and Arno,



Adding it all up:

Data production per half year: 1.8 TB

Extra for 2nd 10B: 0.9 TB

                                                    ------

total 2.7 TB



which is more tham the available 1.9 TB



So, we need another bit of storage.



Arno, can you make a spec of what we need?



Kind regards,

        Harm

>>> Gyula Jozsa <jozsa@astron.nl> 6/28/2010 2:57 PM >>>
Hi all,

I did not go through all proposals, since they are mostly standard ones, using the capacity equivalent of 1024 channel line observations with an integration time of 60s. There is one project, though, R10B/010, for which I calculate the following:

Setup: 1024-channel 2 pol line observation plus 6x64 4 polarisation continuum bands, integration time 10s

Since a usual (1-minute integration time) observation needs 1800 Mbyte/12h and I calculate at the moment 574 h total observing time, I get to

60s/10s * 1800 MByte*(1024+6*128)/1024 channels /12 hours*574 hours Mbyte = 900 000 MByte disk space for this project alone.

Cheers,
Josh
 
Arno Schoenmakers wrote:

WSRT archive diskspace usage since 2006 (Gbyte unless denoted differently):


2006: 517 + 650 + 650 + 650 + 650 + 450 = 3.6 Tbyte
2007: 214 + 650 + 650 + 650 + 650 + 527 = 3.3 Tbyte
2008: 158 + 650 + 650 + 333 = 1.8 Tbyte
2009: 340 + 650 + 650 + 650 + 33 = 2.3 Tbyte
2010: 620 + 650 + 18 = 1.3 Tbyte (up to 28-6-2010)


Still Available: 650 + 650 + 600 = 1.9 Tbyte


Should be just enough for this year. There is an additional 650 Gbyte partition but that is also used for system backups and such.


   Arno




  
 

- Issue History
Date Modified Username Field Change
21-06-10 21:41 Arno Schoenmakers New Issue
08-07-10 07:19 Arno Schoenmakers Note Added: 0000292
08-07-10 07:19 Arno Schoenmakers Status new => closed