Data Storage at IBT

Commentaren

Transcriptie

Data Storage at IBT
Data Storage at IBT
Storage, Concepts and Guidelines
Topics





Hard Disk Drives (HDDs)
Storage Technology
New Storage Hardware at IBT
Concepts and Guidelines
?
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
2
1
Hard Disk Drives (HDDs)
 First hard disk: IBM 350 disk storage unit
 Announced September 4, 1956
 50 magnetic disks containing 50,000 sectors, each of
which held 100 alphanumeric characters, for a capacity of
5 million characters.
 Source: http://www-03.ibm.com/ibm/history
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
3
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
4
2
Disk interface families





Parallel ATA (PATA)
Serial ATA (SATA)
Small Computer System Interface (SCSI)
Fibre Channel (FC)
Serial Attached SCSI (SAS)
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
5
D-ITET/IBT/Bruno Willi
6
Disk interface families
 Parallel ATA (PATA)
 Obsolete
 Replaced by SATA
Freitag, 30. Juli 2010
3
Disk interface families
 Serial ATA (SATA)
 Western Digital, 7200rpm, 500GB, CHF 70. Max Storage Capacity? 2 TB
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
7
Disk interface families
 Small Computer System Interface (SCSI)
 Seagate, 15000rpm, 300GB, CHF 530. Max Storage Capacity? 600 GB
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
8
4
Disk interface families






Fibre Channel (FC)
Expensive Device and Infrastruktur
Fibre Network
Hitachi Data Systems at D-ITET
Host Bus Adapter (HBA)
Spitfire
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
9
Disk interface families
 Serial Attached SCSI (SAS)
 Seagate Barracuda ES.2, 7200rpm, 1TB, CHF 235. Supersides Fibre Disk
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
10
5
Storage Technology
 Storage Area Network (SAN)
 Network-attached Storage (NAS)
 Direct-attached storage (DAS)
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
11
Storage Technology







Storage Area Network (SAN)
Attach remote computer storage devices to servers
Enterprise Market
Separate Network
Fibre Channel switches
Host Bus Adapter (HBA) > Spitfire
Rolls Royce
Rolls-Royce
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
12
6
Storage Technology




Network-attached storage (NAS)
Protocols: NFS, CIFS (SAMBA)
Shared network
Opel Kastenwagen
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
13
Storage Technology
 Direct-attached storage (DAS)
 Your local disk
 Not scaleable
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
14
7
IBTNAS01








DALCO TerraServer2 System
2 x Intel Xeon E5410 4x2.33GHz Processor
24 x 2TB S-ATAII Harddisk Drive 7'200rpm
RAID-6
Three Volume Groups
12 x 1 TB Scratch Partitions
24 x 500 GB Data Partitions
12 TB unassigned
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
15
IBTNAS01




12 x 1 TB Scratch Partitions
No Backup
Data Path: /usr/ibtnas01/scratch-01..12
SAMBA Share Name: \\ibtnas01.ee.ethz.ch\scratch-01..12
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
16
8
IBTNAS01




24 x 500 GB Data Partitions
Daily Backups
Data Path: /usr/ibtnas01/data-01..24
SAMBA Share Name: \\ibtnas01.ee.ethz.ch\data-01..24
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
17
IBTNAS01 - Supported Access Protocols




Network File System (NFS)
Common Internet File System (CIFS)
Secure Shell (SSH)
Secure Copy(SCP)
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
18
9
IBTNAS01 - Supported Access Protocols




Network File System (NFS)
/usr/ibtnas01/scratch-01..12
/usr/ibtnas01/data-01..24
Only selected hosts: casseri01..12
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
19
IBTNAS01 - Supported Access Protocols
 Common Internet File System (CIFS)
 Also known as SAMBA
 C:\> net use X: \\ibtnas01.ee.ethz.ch\scratch-01\hmueller
/user:hmueller
 C:\> net use
 C:\> net use X: /delete
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
20
10
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
21
IBTNAS01 - Supported Access Protocols
 How can I connect to a server using different user
accounts?
t ?
 C:\> net use k: \\ibtnas01\scratch-01 /user:hmueller
 C:\> net use k: \\ibtnas01.\scratch-02 /user:pgruber
 C:\> net use k: \\ibtnas01.ee.ethz.ch\scratch-03
/user:gmerz
 C
C:\>
\ net
et use l: \\
\\129.132.52.142\scratch-04
9 3 5
\sc atc 0 /use
/user:ahuber
a ube
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
22
11
IBTNAS01 - Supported Access Protocols
 Mount CIFS as a Root User
 mount -t cifs -o user=hmueller
//ibtnas01.ee.ethz.ch/scratch-01 /usr/ibtnas01/scratch-01
 Mount as a normal user
 Edit File /etc/fstab
 Use Option user
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
23
IBTNAS01 - Supported Access Protocols




Secure Shell (SSH) / Secure Copy (SCP)
Don't run applications on NAS server!
Putty [email protected]
scp foobar.txt
[email protected]:/usr/ibtnas01/data-01/guber
 http://sourceforge.net/projects/filezilla
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
24
12
Where's the right place for my data?




Local Disk (DAS)
Spitfire (SAN)
IBTNAS01 (NAS)
Jabba (Tape Library)
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
25
Where's the right place for my data?
 Local Disk (DAS)




No back-up required
Synchroniced with Spitfire
Data only used on local host
MP3 and so forth
 http://sourceforge.net/projects/freefilesync/
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
26
13
Where's the right place for my data?
 Spitfire (SAN)
 Backup required
 Less then 50 GB
 Active data only
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
27
Where's the right place for my data?
 IBTNAS01 (NAS) – Data or Scratch
 Data Partition for large data sets with backup
 Scratch Partitions for large data sets without backup
 Static data, archived on Jabba
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
28
14
Where's the right place for my data?

Jabba (Tape Library)
 Archive Data – two copies on different tapes
 Backup Data – one copy on tape
 Closed Projects
 http://www.computing.ee.ethz.ch/Services/DataArchiving
http://www computing ee ethz ch/Services/DataArchiving
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
29
Request Tracker
[email protected]
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
30
15
?
Freitag, 30. Juli 2010
D-ITET/IBT/Bruno Willi
31
16

Vergelijkbare documenten