Wednesday, 16 November 2016

Apache Hadoop

Hadoop is a framework from Apache Foundation for storage and large scale processing of data-sets on clusters of commodity hardware.It is an open source framework. Commodity hardware consists of already available computer hardware that is inexpensive, easy to maintain and works on plug and play basis with other hardware. The principle of using commodity hardware is that it is better to have more computing power by pooling low-cost and low-power hardware in parallel then having a fewer high-cost and high-power hardware. The advantages are use of components based on open standards, easy switching between different hardware and linear scaling in case of increase load. All the modules of Hadoop are designed with the assumption of hardware failures because the commodity hardware is more prone to failure.

Apache Hadoop has its genesis in Google File System and MapReduce paper published in 2003. In 2003 at Apache Foundation Doug Cutting was working on a web crawler project named “Nutch”. To meet the parallel processing need of crawling and indexing, the project implemented distributed file system and MapReduce. In 2006 Hadoop is born out of Nutch and Hadoop is named after the Doug Cutting son’s yellow elephant toy.

Apache Framework : Basic Modules
1.      Hadoop Distributed File System (HDFS)
2.      Hadoop MapReduce
3.      Hadoop Common
4.      Hadoop YARN

IN HDFS, data file is divided into blocks and copies of these blocks are created and stored on other nodes in the Hadoop cluster. The default block size is 64 MB. This redundancy offers high availability. A Higher Block size is recommended as it requires less metadata by the NameNode. Whereas in typical file system on disk the block size is 512 bytes. In RDMS block sizes varies from 4 KB to 32 KB.Each data block is stored by default on three different servers; in Hadoop, this is implemented by HDFS working behind the scenes to make sure at least two blocks are stored on a different rack to increase reliability in the event you lose an entire rack of servers.All of Hadoop data placement logic is managed by a special server called NameNode. The NameNode server keeps record of all the  files in HDFS, like where the blocks are kept and more. NameNode is stored inside the memory for quick response.

Hadoop works on servers available in very large cluster. MapReduce tries to assign commutation to the nodes where the data to be processed is stored, this is known as data locality.Because of above principle SAN or NAS in a Hadoop is not recommended. SAN or NAS the extra network communication overhead can cause performance bottlenecks.IN Hadoop Map Reduce we don't have to deal with Name Node. When a Hadoop Job is fired and the application has to read data and starts to work on the programmed Map Reduce tasks, Hadoop will contact the Name Node, locate the disks that have the parts of the data that need to be accessed to carry out the job and then send your application to run locally on those nodes. Map Reduce is two distinct jobs. The first is map job, which takes a set of data and converts it into individual elements, which are broken down into rows(key/value pairs).  The reduce job takes the output from a map as input and combined those data rows into a smaller set of rows.

In Hadoop, a Map Reduce program is known as a job. A job is executed by dividing it down into pieces called tasks.An application submits a job to a specific node in a Hadoop cluster, which is running a program called the JobTracker, then the JobTracker establish the connection with the NameNode to find out where all of the data required for this job is stored across the cluster, and then breaks the job down into map and reduce tasks for each node to work on in the cluster, then these tasks are scheduled on the nodes in the cluster where the data exists. Note that a node might be assigneda task for which the data required by that task is not local to that node. In such a case, the data will be transferred to that node. In Hadoop cluster, a set of continually running programs, referred to as TaskTracker agents, monitor the status of each task. If the task fails the status is sent back to JobTracker.

Hadoop common components are a set of libraries and programs that are used by the various Hadoop sub projects.YARN (Yet Another Resource Negotiator) is a resource management platform responsible for managing the resources in the Hadoop cluster and utilizing them in order to schedule users and applications. The difference between MapReduce and YARN is that, in MapReduce there is single JobTracker, whereas in YARN we have multiple Application Master which will manage the applications by assigning them to different containers on different Nodes.


 Mr. Vijay Gupta
Assistant Professor
Dept. of Information Technology






HASKELL – Functional Programming Language

Need of Functional Programming Languages
Writing large software systems is really complex, difficult and expensive. Maintaining such complex systems is often time consuming and costly. So it is significant to structure it well. Well-structured and less complex software is easy to write, easy to debug, and provides a set of modules which provides reusability to cut down future programming costs. Functional programming languages, such as Haskell, can make it easier as compared to the conventional languages. Conventional languages lay theoretical restrictions on the way problems can be decomposed. Functional languages push those constraints to back. Haskell is the highest level functional programming language with shorter programs and less bugs.

Functional Language and its advantages
A functional language is one where the exclusive or effective form of expressing algorithms is the interpretation of mathematical functions which involves avoiding state changes and fickle data. This is as against the languages that are declarative, imperative, and procedural which gives priority to state change. Further, Higher level programming languages can write the same program using less lines of code. The number of bugs in a program is proportionate to the number of lines of code, so a shorter program has fewer bugs.

Some of the advantages are:
Brevity: Programs written in functional languages tend to be much shorter than their essential equivalents.
Ease of Understanding: Programs written in functional language are generally not difficult to understand. It would be easier to understand those programs even with very less knowledge of logic.
No Core Dumps: Most functional languages especially Haskell, is a strongly typed language, excluding a huge class of easy-to-make compile time errors. Moreover, strong typing means no core dumps! which simply means that there is no possibility of treating an integer as a pointer, or a null pointer.
Code Reuse: Haskell's is a strongly typed language but is much less restrictive than, say, Pascal's, because it uses polymorphism.
Recursion: Recursion is one of the important features in functional programming, as it is the lawful and often the only way to iterate.
Lazy Evaluation: Authentic computations are referentially clear and they can be implemented at any time and still yield the same result. This property of functional language makes it possible to suspend the arithmetic computations of values until they are needed, that is to compute them lazily.

Haskell as Language
Haskell was designed in 1988 by a committee of academics named after the logician Haskell B. Curry whose work in mathematical logic serves as a foundation for functional languages. The language Haskell is based on the lambda calculus, hence the lambda we use as a logo. The committee’s primary goal was to design a language that satisfied the following constraints:

1. The language should be good enough for research, teaching, and applications for building large systems.
2. The language should have its own syntax and semantics.
3. It should be freely available, which means that anyone should be allowed to implement and distribute it.
4. It should be based on unanimity.
5. It should diminish futile variety in functional programming languages.

The outcome of the committees’ meeting was HASKELL 98 which was one of the standardized versions of Haskell language. HUGS was an interpreter used for Haskell. It was simple for people who were learning the basics of Haskell. It offers speedy compilation and more execution speed. For a beginner, it is an excellent language to step in to programming world, since it doesn't have any complex syntax This is how it works

main = print"Hello, world"
 
To run the program
hugs hello.hs
 
Some of the Tools available for Haskell
The Glasgow Haskell Compiler
The Glasgow Haskell Compiler (GHC) is a state-of-the-art, open source, compiler which gives interactive environment for the functional language Haskell. In addition to the Haskell 98 native code generation across much architecture, GHC implements many cutting-edge features including Software Transactional Memory providing much easy implementation of highly concurrent programs.


Haskell Mode for Emacs
It is a basic Haskell mode for Emacs which provides color coded environment and automatic indentation. In addition, this package comes with Haskell interactive modes for both Hugs and GHCi.
 
Mr. Varun Sapra
Assistant Professor
Dept. of Information Technology

Monday, 7 November 2016

Security Breaches using KeyLoggers & Anti KeyLoggers: An Overview  

With the increased innovation in technology the threat of breach to user’s confidential data has increased by huge degree. Today attackers are growing stronger. They are discovering new ways to pierce the security levels on a rapid rate. Thus security is a key challenging area of research for security managers.
            As far as security is concerned besides social engineering,there are many methods of obtaining confidential information. A very common method to obtain sensitive information includes keystroke logging.
             Keystroke logging is the capture of typed characters. It is often used to gather secure information, commit fraud, or obtain system facility access. The data captured can include passwords, user ID’s, and other sensitive bits of information and the attacker can obtain valuable data without cracking into a hardened database or file server. Keyloggers are a prominent class of malware and so they present a special challenge to security managers. Unlike traditional worms and viruses, certain types of keyloggers are almost impossible to detect and work well because they’re simple. They just take raw information – keystrokes – and ship them out of your computer to a third party and that is why this can pose a serious threat to users. As a result, cyber criminals can get PIN codes and account numbers for e-payment systems, email addresses, user names, email passwords or any potential information can be logged quickly without any apparent performance impact on the target PC and surprisingly most users infected with a keylogger will never know it unless an account or credit card is hijacked.In this way,the access to confidential data can sometimes have consequences which can be quite serious.
The most common ways of doing this is through phishing, social engineering, bundling the keylogger with other software .The main idea behind keyloggers is to get in between any two chain of events for example when a key is pressed and when information about that keystroke is displayed on the monitor. This can be achieved using video surveillance, a hardware bug in the keyboard, wiring or the computer itself or requesting information from the keyboard using standard methods.
Though Keyloggers are tricky to detect, still there are some typical signs. For instance you may encounter   slower performance while web browsing, your mouse or keystrokes pause or don’t show up onscreen as what you are actually typing or if you receive error screens when loading graphics or web pages.
CATEGORIES:
 There are two categories of keyloggers
Software-based keyloggers are used to intercept your keystrokes, mouse clicks, clipboard contents, URLs i.e. all the user activity. The second type of keyloggeris  hardware-based keyloggers are physical devices that are usually plugged  between the keyboard and intercept keystrokes typed.

HOW TO PREVENT AND PROTECT THE PC:
Since the chief purpose of keyloggers is to get confidential data, the most logical ways to protect against unknown keyloggers are as follows:
With the help of a one-time password the threat can be minimized .Even if the password you enter is intercepted, the password generated can be used one time only.  So Even if the one-time password has been intercepted, the cybercriminal will not be able to use it to obtain access to critical information.,
  •          By using a system with proactive protection designed to detect keylogging software,
  •          By using a virtual keyboard.
  •          Always Use licensed anti-virus software and update it regularly.
  •          On a regular basis, Update your OS
  •          Be extra cautious while you enter confidential credentials. A simple way can be that one may enter some extra characters -And then delete them using the mouse
  •          By trying an alternative keyboard layout .Since most of the keylogger software available is based on the typical older QWERTY layout so if you use a keyboard layout such as DVORAK, the captured keystrokes does not make sense unless converted.

Ms. Shweta Ohri
Assistant Professor
Dept. of Information Technology

Monday, 24 October 2016


The role and influence of mass media in society

Media is the most powerful instrument in communicating to the masses. As we belong to the age of communication, sharing and exchange of information becomes vital. Mass media are vehicles for the transfer of ideas, concepts information to both general and specific audiences. Media is called the forum for public or people’s assembly. It plays the role of bridge between general people and government in times of different national need. Media not only provide people with news, information and ideas but also raise various issues on socio-economic-political matters. They also form public opinions and consciousness in different problems and issues and influence the mindset of people regarding that existing issue, event or situation.

With the advancement of digital technology, mass media have become quick, easy & powerful ways of communication, sharing, exchange and broadcasting news and views, disseminating ideas and messages and making information accessible anywhere in the world. The influence and impact of mass media is persistent in almost all the aspects of our life. Mass media have reflective control on people’s thinking, feelings, sensibilities sentiment, and their means of reactions. Thus, media can direct public to both positive in a constructive and negative in a destructive manner on various agendas. If the power of media is used optimistically it can do well to society and a country. But if the power is misused for any vested-interest then it can cause anarchy, great harm, and confusion in state and in the society. Media are so powerful, impactful and influential that people instantly suppose what they hear or watch on media. That is why famous Canadian theorist and media critic Marshall McLuhan said that “Media is the message”

The mass media are competent to facilitate short-term and long-term effects on audiences. Short-term purpose include exposing audience to creating awareness and knowledge; and enhancing audience thinking and help in changing their attitudes, behaviors, and perceptions of social norms. Long-term objectives include all of the aforesaid tasks, in addition to paying attention in reforming of apparent social norms, and maintenance of behavior change. Mass media performs three key functions: educating, helps in shaping public relations, and also advocating for a particular policy or point of view. So, we can state that Media not only communicate knowledge, but can be part of larger efforts to encourage and endorse actions having community efficacy.  Mass media assist leaders in setting an agenda on policy, shaping the debates about contentious or controversial issues, and gaining support for particular perspective.


Mass media play a significant role in today’s world of information and communication. It is up to us to draw advantage or disadvantage from media in order to appraise and judge the message of media. We need to be meticulous about dealing with mass media. Considering the far-reaching influence, the concerned authorities should use the media for the greater advantage of mankind.

Ms. Garima Malhotra
Assistant Professor
Dept. of Communication Studies


PHONEBLOKS: A Phone to Keep

Hundreds of years ago, the idea that one could access all of the information the world has ever known with a device that could fit in pocket was unfathomable. With the invention of the internet, this idea began to become a reality as society made major strides in the advancement of communication technology. In recent years, the smartphone has reigned as the primary method for non-face-to-face communication due to its features of being portable and easily accessible, and was the first true device to be able to carry out this “unfathomable” feature of unlimited access to information. It seems like most people get a new cellphone every year– and while that’s good news for phone manufacturers and telecoms industry, it’s not helping our wallets or the environment.

One negative consequence of the smartphone, however, are the amount of hazardous waste produced each year by the world’s booming population. This high volume of hazardous waste is contaminating the earth on an immense scale, and needs to be addressed in order to support a sustainable planet. Project Ara, a project headed by Google, addresses this problem by creating a modular system for smartphones in which only certain components of a smartphone need to be disposed of at a time, as opposed to disposing of an entire smartphone for one minor flaw.

A Module Phone - “Modules are the building blocks of an Ara phone. They are the hardware analogue to software apps. These are physical components that implement various phone functions. There are two major classes of modules: Front modules, which make up the front of the phone and generally provide user interaction or interface affordances such as the display, speaker, microphone, etc., and rear modules, which provide the bulk of the phone’s back-end functionality.

Environmental Implications of Phonebloks:

In addition to being able to customize the phone, users can mitigate hazardous waste by replacing only the components that are expired or undesirable, as opposed to disposing the entire smartphone.

"Usually a phone is integrated into one solid block and if one part gets broken you have to throw away the entire phone,". "But this has different components, so if  your battery is broken you can replace the battery or if you need a better camera you only upgrade the camera component. So you don't throw away the entire phone; you keep the good stuff."       
                                                                


The whole idea is to generate lots of buzz, so companies see there's a huge market and realize that they really need to make a phone like this.

The Phonebloks concept features electronic blocks that snap onto a base board, which links all the components. Two small screws lock everything together. Users can choose components from their favourite brands or make their own modules.

"You can customise your phone, replacing the storage block with a larger battery if you store everything in the cloud, or replace advanced components you don't need with basic blocks like a bigger speaker," says the video explaining the concept.

Phonebloks will lead to fewer phones being thrown away, thereby reducing waste. Electronic devices are not designed to last. This makes electronic waste one of the fastest-growing waste streams in the world and our phone is one of the biggest causes.


Ms. Sakshi Chhabra
Assistant Professor
Dept. of Management Studies

Network Effects (Digital Strategy)

As technology tends to grow, managers face a lot of questions. Having a strong digital strategy in a highly competitive environment is an integral component to ride against the wave of digital disruption.

But before we think about planning a strategy, it is important to understand the dynamics of why most startups/ businesses fail and why some win. The answer is - Connections. Innovation in products do matter, no doubt. But most importantly, the underlying connection between the products and its users or other products is the reason why they become successful and sustainable.

A very good example of how “network effects” plays an important role in growth is looking at Whatsapp - An instant messaging platform. The reason why Whatsapp is successful, even though there are a lot of IM platforms in the market is because it benefits from the Network Effects. One prefers whatsapp because their friends use whatsapp and as the number of users grow, more users are willing to use this platform.

Innovative businesses like Amazon have realised the potential of Network Effects and have shifted their focus from product creation/ manufacturing to providing a Platform to create a connection between the customers and suppliers.

The main reason why most customers prefer Amazon for purchasing products online than other platforms is because customers get variety and choices from a large pool of suppliers. The same is with the suppliers because a large amount of traffic turns up on the Amazon platform. This network continues to grow. Again, the connections help the business benefit from the Network Effects.

So many services online are for now for free such as - Google Docs. Yet, the businesses still make a lot of money. The answer is again - Connections. Creating a storage and file sharing platform, several products such as Google Docs, Sheets, Forms, Photos and others share the same Google cloud storage drive accessible under one single E-mail ID.

This gave Google a competitive advantage and is the reason why customers using Google Drive are less likely to shift to other cloud storage platforms like Dropbox. And platforms benefit from the Network Effects.

The reason of why Android platform has always been successful than Mac OS/IOS or other OS is simply because of the network effects. As customers chose the android platform, they drew developers to build more apps.

And as the number of developers increased leading to the increase in the number of apps on the platform, it drew more and more customers to choose the android platform. Unlike Mac OS/ IOS or windows OS, Android provided more choices and varieties of apps to its users and the developers got the benefit of spreading the fixed costs associated with the app and reach a large number of customers. It benefitted both.


Again, the Network Effects played an important role in growth, cost reduction and profits.  

Ms. Smriti Dua
Assistant Professor
Dept. of Management Studies

Monday, 17 October 2016

Time to Bridge Digital Divide Gap in Digital India

The term “Digital Divide”, is a social issue referring to the differing amount of information between those who have access to the digital devices, internet along with other IT services and those who do not have access. The term became popular among concerned parties, such as scholars, policy makers, and advocacy groups, in the late 1990s.

The major reasons for bridging the digital divide gaps are Social and Economic Equality, Social Mobility, Democracy and Economic Growth.to name the few(2). All these issues are somehow interlinked and point in the direction of need of Information Communication Technology (ICT) services through computer or mobile phone access with internet and communication applications for many services such as security, safety, health, crime control, emergency service, peoples career, civic life, social welfare services, public decision making processes, productivity improvisation etc. and many more. The under privileged sections of society having no access or less access requires the focus more.

Current Scenario

As the PM Mr. Narender Modi said in the NITI Aayog annual conference, held in Vigyan Bhawan, Delhi in September’2016, “we are in a world, where the “change” is constant and we are just “variables”, we must change for growth”. It is noticed that the growth is not required in major metros, but in the upcountry, as the person working on a project at this level is not aware of latest technology and doesn’t have appropriate resource knowledge to participate.

Govt. has launched many projects like Kisan Call Centre, Life Line India, Bhoomi Project, Gyandoot Project at rural level in the past to bridge this gap. The Government is determined to see the benefits of Information Technology do not remain confined to higher classes of society and intends to use ICT to provide new opportunities to segments of society who do not see opportunities to improve their quality of life. The government shall take the following catalytic, pro-active and enabling steps in this direction:

Enabling Literacy and Education for the masses
Fulfilling local information needs of the people
Educating citizens about their duties
Enabling e-tourist
Enabling women
Enabling & Educating  underprivileged children

Upcoming Projects

Microsoft is working with device makers in India to make technology accessible to more people to help bridge the digital divide(1). Microsoft is working with 20 local partners, including Micromax and iBall, along with multi-national partners Lenovo and Acer to bring new form factors to the Indian market through affordably-priced devices. In this direction Microsoft is trying to work on devices that are able to access information that is stored in specific cards and smart chips issued by the government, and can be used in medical profession for health sector in India as used in Europe already. Micorosoft is working with their local partners to understand the unique requirement of the Indian market, where with biometrics, ID or scan elements can come together to create custom devices that will serve the specific needs of the country.

In addition to Digital India workshops being organised in 120 universities, covering 2,400 colleges and 30,000 students, Infosys co-founder, Kris Gopalakrishnan, recently turned in an ambitious report on how to realise the Digital India programme.

Google has also set a digital locomotive in motion by announcing plans to build on its initial success in creating WiFi hotspots around railway stations, in partnership with the telecom arm of Indian Railways.

Mobile has the potential to drastically accelerate economic growth in India, as well as overcoming a range of social challenges, such as closing the digital divide and bringing financial inclusion to all segments of the population.To spread the awareness on the many companies multinational companies like GSMA are coming forward with conference “GSMA Mobile 360 Series – India”, representing the interests of mobile operators worldwide, uniting nearly 800 operators with almost 300 companies in the broader mobile ecosystem, including handset and device makers, software companies, equipment providers and internet companies, as well as organizations in adjacent industry sectors. It is one of the first steps towards highlighting Mobile as the Key Enabler for Development of India focusing on programs including Mobile Money, Connected Women, Digital Identity and Agriculture.

Conclusion

The digital divides is persistent and still with us but many private sector companies, the educated sections of society and government are throwing the thrust for bridging the gap at all levels possible along with building a well informed and literate society. Since India’s heart lies in its villages, the rural sector is still left behind in terms of right resources and people to provide them with powers and channels to be part of latest communication system, so more efforts required for promotion of services at this level. The exploitation of the latest technologies and forward thinking approach of the government at this time presents both the opportunity and the security bridging this gap of digital divide, which will surely play a critical role in the country’s economic and social development along with giving industries of developing countries a competitive advantage.

References

1. Celis, Alvaro.Microsoft focussed on closing digital divide in India, says Global VP Alvaro Celis. [interv.] Danish Khan. september 23, 2016.
2. A Brief View to Digital Divide in Indian Scenario. Ipsita Panda, Durllav Charan Chhatar and Bulu Mharana. 2013, International Journal of Scientific and Research Publications, Volume 3, Issue 12, December 2013, pp. 1-7.
3. Iansiti , Marco and Richards, Gregory L. .Information Technology Ecosystem Health and Performance. Boston  : Harvard Business School Working Knowledge , 2006.

Dr. Harsha Ratnani
Associate Professor
Dept. of Information Technology