Data Staging Minutes 240310
Data staging meeting 24/3/10 12:00
Present: Aleksandr, David, Ali, Dmytro
Summary of problem:
Current framework is out of date and stretched to its limits. It is also inflexible. We need a replacement. All known important issues are covered in wiki page.
Hard/impossible to control bandwidth used by transfers, so we can only control queueing.
3 levels of fair share/priority/queueing:
- between groups
- within groups
- within single user's jobs.
URLs: hard to handle with options etc. Need new solution.
Big/small transfers: can pause big transfers to allow small ones through.
Catalog look up/negotiation protocols should not block transfers.
First look at other systems for possible implementation or ideas:
- gLite FTS (David/Dima)
- put ideas on wiki as they come up
- Aleksandr make diagram of layers
- keep eye out for other ideas
- David/Dima review FTS and have something by next meeting
in 2 weeks (week of 5th April) due to Easter