Storage

Some useful links to explain the concepts of Storage, I/O

Concepts

• http://linuxbsdos.com/2011/09/18/guide-to-disks-and-disk-partitions-in-linux/

• http://www.howtogeek.com/howto/35676/how-to-choose-a-partition-scheme-for-your-linux-pc/

• http://www.slashroot.in/linux-system-io-monitoring

• http://www.cyberciti.biz/tips/linux-disk-performance-monitoring-howto.html

• http://xmodulo.com/how-to-monitor-disk-io-in-linux.html

• http://www.cyberciti.biz/tips/freebsd-why-command-df-and-du-reports-different-output.html

• http://yoonusp.blogspot.in/2012/06/du-and-ls-output-show-different-sizes.html

• http://www.howtogeek.com/howto/38125/htg-explains-what-is-the-linux-fstab-and-how-does-it-work/

• http://linoxide.com/file-system/understanding-each-entry-of-linux-fstab-etcfstab-file/

• http://geek-university.com/linux/etc-fstab-file/

GRUB

• https://linuxnorth.wordpress.com/2011/03/09/grub2-revisited/

• http://askubuntu.com/questions/2793/how-do-i-remove-or-hide-old-kernel-versions-to-clean-up-the-boot-menu

• http://askubuntu.com/questions/218286/how-can-i-safely-remove-extra-grub-installs

• http://docs.fedoraproject.org/en-US/Fedora/20/html/Installation_Guide/sn-medialess-editing-grub-conf.html

• https://ask.fedoraproject.org/en/question/32771/multiple-fedora-entries-in-grub/

LVM

• http://www.tecmint.com/create-lvm-storage-in-linux/

• http://www.howtogeek.com/howto/40702/how-to-manage-and-use-lvm-logical-volume-management-in-ubuntu/

• http://www.cyberciti.biz/tips/fdisk-unable-to-create-partition-greater-2tb.html

• https://www.atlantic.net/community/howto/configure-2tb-partitioning-parted-mdadm/

• http://www.tecmint.com/parted-command-to-create-resize-rescue-linux-disk-partitions/

• http://www.thegeekstuff.com/2012/08/2tb-gtp-parted/

• http://www.thegeekstuff.com/2011/09/parted-command-examples/

• http://magicmonster.com/kb/os/linux/large_hdd.html

• http://www.cyberciti.biz/tips/fdisk-unable-to-create-partition-greater-2tb.html

RAID

• http://www.slashroot.in/raid-levels-raid0-raid1-raid10-raid5-raid6-complete-tutorial

• http://www.tecmint.com/understanding-raid-setup-in-linux/

• http://www.thegeekstuff.com/2010/08/raid-levels-tutorial/

• http://www.thegeekstuff.com/2011/11/raid2-raid3-raid4-raid6/

• http://www.thegeekstuff.com/2011/10/raid10-vs-raid01/

• https://www.pugetsystems.com/labs/articles/RAID-Explained-24/

• http://www.tldp.org/HOWTO/Software-RAID-HOWTO-11.html

• http://www.gagme.com/greg/linux/raid-lvm.php

• https://wiki.archlinux.org/index.php/Software_RAID_and_LVM

• https://www.cyberciti.biz/tips/raid-hardware-vs-raid-software.html

• http://www.olearycomputers.com/ll/linux_mirrors.html

• https://raid.wiki.kernel.org/index.php/Linux_Raid

• http://cavepopo.hd.free.fr/wordpress/linux/how-to-create-a-raid-array-using-omconfig-omreport-cli/

GlusterFS

• https://www.interserver.net/tips/kb/what-is-glusterfs/

• http://www.slashroot.in/gfs-gluster-file-system-complete-tutorial-guide-for-an-administrator

• http://www.tecmint.com/introduction-to-glusterfs-file-system-and-installation-on-rhelcentos-and-fedora/

• https://www.digitalocean.com/community/tutorials/how-to-create-a-redundant-storage-pool-using-glusterfs-on-ubuntu-servers

• https://gluster.readthedocs.io/en/latest/Quick-Start-Guide/Quickstart/

NFS

• http://cavepopo.hd.free.fr/wordpress/linux/about-nfs/

• http://cavepopo.hd.free.fr/wordpress/network/nfs-the-network-file-system-practical-examples/

• http://www.cyberciti.biz/faq/mhddfs-linux-combines-a-several-mount-points-into-single-one/

• https://romanrm.net/mhddfs

• http://www.tecmint.com/how-to-setup-nfs-server-in-linux/

SCP

• http://www.tecmint.com/scp-commands-examples/

• http://www.binarytides.com/linux-scp-command/

• http://www.garron.me/en/linux/scp-linux-mac-command-windows-copy-files-over-ssh.html

Rsync

• http://www.server-world.info/en/note?os=CentOS_6&p=rsync

• https://www.linode.com/docs/tools-reference/tools/introduction-to-rsync

• http://www.evbackup.com/support-commonly-used-rsync-arguments/

• http://www.tecmint.com/rsync-local-remote-file-synchronization-commands/

• http://www.thegeekstuff.com/2010/09/rsync-command-examples/

• http://www.howtogeek.com/175008/the-non-beginners-guide-to-syncing-data-with-rsync/

• http://www.techonthenet.com/linux/commands/rsync.php

• https://unix.stackexchange.com/questions/4712/rsync-two-file-types-in-one-command/4713#4713

• http://www.crucialp.com/resources/tutorials/server-administration/how-to-copy-files-across-a-network-internet-in-unix-linux-redhat-debian-freebsd-scp-tar-rsync-secure-network-copy/

• https://stackoverflow.com/questions/20244585/how-does-scp-differ-from-rsync/20257021#20257021

• https://unix.stackexchange.com/questions/4712/rsync-two-file-types-in-one-command/4713#4713

LsyncD

• http://www.nginxtips.com/lsyncd-live-file-syncronization-linux/

• http://www.rackspace.com/knowledge_center/article/install-and-configure-lsyncd

• http://crosstek.net/2013/06/28/two-way-sync-with-lsyncd-in-a-clustered-wordpress-installation/

Explanation of lsyncd.conf parameters

• https://www.lucasrolff.com/ha/replication-using-lsyncd/

• https://github.com/axkibe/lsyncd/wiki/Manual%20to%20Lsyncd%202.1.x

Max User Watches Error of Lsyncd

• https://xopo3o.blogspot.in/2015/11/how-to-lsyncd-error-consider-increasing.html

• https://unix.stackexchange.com/questions/13751/kernel-inotify-watch-limit-reached

Configuration

• http://askubuntu.com/questions/109856/how-to-mount-a-windows-folder-in-linux

• https://access.redhat.com/solutions/448263

• http://www.tecmint.com/fdisk-commands-to-manage-linux-disk-partitions/

• http://www.thegeekstuff.com/2010/09/linux-fdisk/

• https://wiki.ubuntu.com/MountWindowsSharesPermanently

• http://www.cyberciti.biz/faq/linux-finding-using-uuids-to-update-fstab/

• https://codesilence.wordpress.com/2013/03/14/live-resizing-of-an-ext4-filesytem-on-linux/

• https://www.tecmint.com/parted-command-to-create-resize-rescue-linux-disk-partitions/

Creating & mounting a 2nd Hard drive in linux

• http://geektnt.com/how-to-format-and-mount-second-hard-drive-on-linux.html

Good explanation fstab parameters

• http://ubuntuforums.org/showthread.php?t=1604251

Troubleshooting & Log Parsing

• http://www.tecmint.com/linux-performance-monitoring-with-vmstat-and-iostat-commands/

• http://linoxide.com/linux-command/linux-iostat-command/

• http://www.thegeekstuff.com/2011/07/iostat-vmstat-mpstat-examples/

• https://www.linode.com/docs/uptime/monitoring/use-vmstat-to-monitor-system-performance

• https://www.thomas-krenn.com/en/wiki/Linux_Performance_Measurements_using_vmstat

• https://www.thomas-krenn.com/en/wiki/SMART_tests_with_smartctl

• https://www.cyberciti.biz/hardware/linux-iotop-simple-top-like-io-monitor/

• http://articles.slicehost.com/2010/11/12/using-iotop-to-check-i-o-and-swap

Online Visual RAID Calculator

• https://www.synology.com/en-global/support/RAID_calculator

• http://grijpink.eu/tools/raid/index.php