Technologies

NOTE:


www.apache.org have so many new things to learn. Follow the new stuffs over there and you can learn a lots, that is new to the IT.


Few more new technologies:
- Apache Mesos -> http://mesos.apache.org/
  Making it easy to build resource-efficient distributed systems

- Spark -> http://spark-project.org/ :

Spark is an open source cluster computing system that aims to make data analytics fast — both fast to run and fast to write.Spark is also the engine behind Shark, a fully Apache Hive-compatible data warehousing system that can run 100x faster than Hive.To run programs faster, Spark provides primitives for in-memory cluster computing

http://spark-project.org/examples/

Few top Sites:
https://amplab.cs.berkeley.edu/projects/
http://www.apache.org

Spark, 
Shark, 
GraphX, 
ZooKeeper
https://github.com/amplab/shark/wiki
http://spark-project.org/docs/latest/
https://github.com/amplab/shark/wiki
https://amplab.cs.berkeley.edu/projects/
http://www.scala-lang.org/







•High quality technical documentation, runbooks, diagrams.
•PCI-DSS compliance and implementation.
•Platforms - CentOS/RHEL, Debian, Solaris and FreeBSD.
•Shell scripting, Automation, UNIX/GNU tools.
•Deep understanding of critical networking fundamentals, tools, protocols.
•Virtualization - VMWare Vsphere, ESX/ESXi, Xen.
•Security - Bluecoat, Checkpoint, ASA/PIX, SonicWall.
•Hardware - Dell, HP, Sun, Cisco, IBM, EMC, Netapp, Hitachi
•MTA/SMTP - Postfix/Sendmail, Exchange, Zimbra
•Enterprise Monitoring - Nagios, SolarWinds, Cacti, BMC.
•ITIL - problem/incident management, change management, continual service improvement.

Specialties: Enterprise Systems Administration, Infrastructure Design/Architecture, Automation, HA/DR, Linux, UNIX, Scripting, Bash, Perl, Python, Apache, MySQL, SAN/NAS, Virtualization, LDAP, Virtualization, SMTP, Postfix, VMWare, Xen, Enterprise Server Hardware (HP, Dell, Sun, Cisco, IBM), Enterprise Monitoring (Nagios, BMC Patrol, SolarWinds Orion, Zenoss, Cacti), PCI-DSS, Bluecoat, Netscaler/F5, Active Directory, Exchange, DLP, iptables, MSSQL



*) Technology:

Zabbix
glusterfs
monit
bacula : -> open source network backup.
powerdns

nagios
puppet
Cacti
OpenTSDB
ganglia
Flume
Hadoop
logstash
graphite

Technology I need to learn:
GFS, BigTable, MapReduce, Chubby and large-scale 'cloud computing' clusters.
Languages: Python, Ruby, PHP, Perl, Javascript, Shell
SQL/Database : MySQL, SQLite, Cassandra
Distributed Caches: Redis, Memcache
Distributed Processing: Hadoop + Pig + ZooKeeper + Mahout
Cloud Platforms: Amazon Web Services, Google App Engine, Microsoft Azure
Protocols: XMPP, Jingle, ICE, RTSP, SMTP, POP, IMAP
Installers: NSIS
Code Repository Tools: Git, SVN, CVS
Collaboration: JIRA, Confluence
Build Management: Ant, Maven, MsBuild, Nant, Glu, Hudsan
OS: Linux (Redhat, CentOS), Ubuntu, freebsd
Monitoring: Nagios, Cactii, Ganglia, nagiosgraph, RRDTools, Ntop
CI: Teamcity, Clover, Hudson
Config Management: Puppet
Infrastructure: ServerIron Load Balancers,
File Systems: Ext3, NTFS, XFS, GFS
Mail Servers: Qmail, Postfix, Sendmail
App/Web Servers: Tomcat, Resin, IIS, PHP Accelerator, Jetty, apache http
Mailing List: Exmlm, Mailman, Sympa
Jabber Servers: eJabberd, Tigase, Openfire
VOIP Servers: Asterisk
DNS Servers: BIND, Power DNS,
Proxy servers: Squid, ISA, Perdition, NGinx, Varnish, Perlbal
Few more: tcp/ip, http, load balancers, web servers, memcache,
DB Replication: Slony, MSSQL Replication
FTP Servers: Proftpd, VSftpd
Virtualization: Xen, VmWare
Patch Management: WSUS, Yum, up2date
Apache, memcached, Squid, MySQL, NFS, DHCP, NTP, SSH, DNS, and SNMP
Advanced knowledge of Linux, TCP/IP and web services
A strong background in internet service deployment, provisioning, IP networking, service infrastructure, or software deployments.
Bootstrap, other, awk, sed, tc, cfengine, openNMS, MRTC, OpenVPN, HAProxy.
Security and venerability tools, CISSP, CEH tools.
Storage. 
Dbugging tools, gd, firefox web tools: greasemonkey and other imp web imp tools/plugins.

Queue system: [ Message Broker ]
. Gearman
. RabbitMQ
. ZeroMQ
. Amazon SQS
. WebSphere  MQ [ MQSeries ]
. Advanced Message Queuing Protocol [ AMQP ]
. http://en.wikipedia.org/wiki/Gearman
. Redis
- web analytics softwares:  [ Analog, AWStats,CrawlTrack, Open Web Analytics, Piwik, W3Perl, Webalizer, syslog-ng ]
- awstat [ sudo apt-get install awstat ] at browser: file:///usr/share/doc/awstats/html/index.html
- webalizer [ web log analysis software ]
- nodejs
- mongodb

Development
Languages: Scala, Python, Ruby, Java, C#, VB.net, PHP, VC++, C++, Perl, XUL, Javascript, C, Shell
Web Technologies: HTML 5, CSS, Dojo, jQuery, YUI, Flash, Silverlight
Frameworks & Libraries: Hibernate, Hibernate Shards, Spring, Apache MINA, Project Grizzly, log4j, XAPool, Poolman
RDBMS: Postgres, MySQL, Microsft SQL Server, Firebird, SQLite
NoSql Stores: Redis, Cassandra, Voldemort, Berkeley DB
Distributed Caches: Redis, Memcache
Distributed Queues: Kestrel, RabbitMQ
Distributed Processing: Hadoop + Pig + ZooKeeper + Mahout
Cloud Platforms: Amazon Web Services, Google App Engine, Microsoft Azure
Protocols: XMPP, Jingle, ICE, RTSP, SMTP, POP, IMAP
Scripting: Perl, Python, Ruby
Unit Testing: JUnit, NUnit, MbUnit
Stress Testing: Jmeter, Tsung, Iozone, Iometer, Bonnie, Bonnie++
Functional Testing: Watir, Selenium
Installers: NSIS
Code Repository Tools: Git, SVN, CVS
Collaboration: JIRA, Confluence
Build Management: Ant, Maven, MsBuild, Nant
CI: Teamcity, Clover, Hudson
IDEs: Aptana, Komodo, Eclipse, IntelliJ, Visual Studio, EMacs!
System Administration
OS: Linux (Redhat, CentOS), Windows
Monitoring: Nagios, Cactii, Ganglia
Config Management: Puppet
Infrastructure: ServerIron Load Balancers, Cisco ASA Firewall, FC/iSCSI SANs (Comet, Dell)
Scripting: Bash, Perl, Expect, Python, PHP, VBS, Powershell
File Systems: Ext3, NTFS, XFS, GFS
Other: DRBD, Heartbeat, ldirectord, RIS, LVS
Servers
App/Web Servers: Tomcat, Resin, IIS, PHP Accelerator, Jetty
Mail Servers: Qmail, Postfix, Sendmail
Mailing List: Exmlm, Mailman, Sympa
Antivirus / Antispam: clamd, Razor, Kaspersky server, Pyzor, Policyd, RBL/DNSBL
Jabber Servers: eJabberd, Tigase, Openfire
VOIP Servers: Asterisk
DNS Servers: BIND, Power DNS, DLZ, Microsoft DNS
Proxy servers: Squid, ISA, Perdition, NGinx, Varnish, Perlbal
DB Replication: Slony, MSSQL Replication
FTP Servers: Proftpd, VSftpd
Virtualization: Xen, VmWare
Patch Management: WSUS, Yum, up2date
UI
UI Prototyping: Balsamiq, Axure
Design: Photoshop, Flash, Coreldraw
Web: ECMAscript (actionscript/javascript), RSS, XML, HTML (4.01), XHTML, CSS1.0 & CSS2.1


Few companies are looking for the following skills for there "Site Reliability Engineer" (SRE) :

real-time metrics
deployment
Apache Http
Nginx
mysql
node.js
solr
Ruby
perl
python
java
php
Lucene
Scala
system level thinking ability
SOLR or Lucene
Scala
Performance Tuning
chef
puppet
unix
Scrum
FreeBSD
Ubuntu
Redhat
Hadoop
Riak
ZooKeeper
RabbitMQ
Haproxy
AWS
OpenStack
Cloud Foundry
Heroku
Linux Kernel Internals
Filesystems
High availability
High performance
High security
Salt
SVN, GIT
PostgreSQL
Cassandra
Mysql
tcpdump
device drivers
FreeBSD
dtrace
ktrace
load balancing
LAMP stack
column stores
erlang
haskell
scala
scheme
tcp/ip
http
security
storage
memcache
code-review
Sharing and Guding others
capistrano
mesos
scribe
capacity planing
CDN
memcached
squid
nfs
dhcp
ntp
ssh
dns
snmp
Varnish
Redis
Nagios/Icinga
OpenTSDB

Artifactory Repository