[原]sqoop1.4.2 从Oracle装载数据到HDFS
如果需要创建hive表的话，则执行sqoop的机器需要可以直接执行hive。 sqoop import --connect jdbc:oracle:thin:@//192.168.1.222:1521/orcl --username ss -password ss --table ABTABLE --hive-import --hive-database default...
View ArticleClik here to view.
Using MongoDB Atlas From Your Favorite Language or Framework
Developers love working with MongoDB. One reason is the flexible data model, another is that there’s an idiomatic driver for just about every programming language and someone’s probably already built a...
View ArticleClik here to view.
Instrumentalize Hadoop cluster with MyCloudManager
Launch Stacks This tutorial will show you how your instrumentalize your hadoop cluster with MyCloudManager stack to benefit from monitoring, supervision, alerting, log management, backup, etc of your...
View Article.NET and Couchbase - August 2016, Dayton Ohio (video)
I was a guest speaker at the Dayton .NET Developers Group on August 24, 2016. My topic was Full Stack Development with .NET and NoSQL . The group and venue kindly allowed me to record the session, and...
View ArticleClik here to view.
Big data booming, fueled by Hadoop and NoSQL adoption
Image: iStockphoto/Sergey Nivens Big data has finally hit its stride, and will explode in growth over the next five years, according to a Forrester Research report released Thursday. In the past five...
View Article[Cassandra经验谈] 推荐一个Lucene搜索插件
搜索，一个数据库无法绕过的话题。之前我们已经知道，在Cassandra之中并没类似mysql的like查询。 要想完成一致的实现like查询，估计就要上Spark进行全表扫描，将like操作放到Spark App来实现。 如果想实现一个不一样（而不是不同）的like查询，可以使用Lucene进行搜索。有两种现成的实现方案： DSE（付费企业版）集成的solr 开源免费的Lucene插件...
View ArticleClik here to view.
New HDF Product Integration Certification Program
Expanding the Data In Motion Ecosystem of Hortonworks DataFlow The Hortonworks DataFlow (HDF ) ecosystem continues to accelerate, with 170+ connectors to different systems that support wide-scale...
View ArticleClik here to view.
Improving the Hadoop DFS Web UI
Here at Altiscale, we have a diverse set of customers, from media companies to financial services firms to manufacturers. This leads to a diverse set of requirements on the Altiscale Data Cloud, and...
View ArticleApache Hadoop Interview Questions - Set 1
1. What is Hadoop ecosystem and its building block elements ? Answer :- The Hadoop ecosystem refers to the various components of the Apache Hadoop software library, as well as to the accessories and...
View ArticleRedis 3.0入门二之集群搭建和使用
上一篇文章讲了redis的主从搭建，主从一般只能解决我们读写分离的问题，可以增加我们的系统的负载能力，但是并不能解决单点问题，大家应该知道在互联网公司各个服务肯定不能出现单点问题，所以这一节就记录一下如果让我们的系统更加高可用。 一、集群搭建 需要先说明的是，集群搭建需要至少6个节点：3主3从(因为没有那么多机器，所以就在一台上搞了) 1....
View ArticleClik here to view.
快播CEO认罪，成人网站对技术的要求有多高？
声明：本文从技术角度讨论成人网站，内容完全健康，其中所涉及的网站名称、网址均作了替换。原文标题“在整个互联网中，成人网站有多大？”文章由伯乐在线 黄利民 翻译自 extremetech。摘自程序员的那些事（微信号：iProgrammer）http://blog.jobbole.com/12479 △图片来源：finance.qq.com...
View Article[Cassandra教程] （十）二级索引(Secondary Index)
1.什么是二级索引? 我们前面已经介绍过Cassandra之中有各种Key，比如Primary Key， Cluster Key 等等。如果您对这部分概念并不熟悉，可以参考之前的文章： [Cassandra教程] （四）使用Key的正确姿势 对于Cassandra来说，一级索引就是Primary Key. 因为查询的时候，可以直接根据Key算出token然后直接获取对应的记录。...
View Article【MySQL】MyISAM与InnoDB的区别
mysql默认采用的是MyISAM。MyISAM不支持事务，而InnoDB支持。 InnoDB不支持FULLTEXT类型的索引。 InnoDB支持外键，MyISAM不支持。 InnoDB的主键范围更大，最大是MyISAM的2倍。 MyISAM支持GIS数据，InnoDB不支持.即MyISAM支持以下空间数据对象：Point,Line,Polygon,Surface等。 InnoDB...
View ArticleConsistency is Consistently Undervalued
Microservices and NoSQL have been trendy over the last few years due mainly to their success at large companies like Google. I’m not going to tell you not to use them, but I am going to try to explain...
View ArticleRedis 3.2 新功能：GEO 地理位置命令介绍
概述 redis3.2发布rc版本已经有一段时间了，估计RedisConf 2016左右，3.2版本就能release了。3.2版本中增加的最大功能就是对GEO（地理位置）的支持。说起redis的GEO特性，最大的贡献还是咱们中国人。redis作者在对3.2引进新特性的博客中介绍了为什么支持GEO。GEO...
View Article运维常用工具汇总
操作系统 ：Centos※,Ubuntu,Redhat※,suse，Freebsd 网站服务 ：nginx※,apache※,tomcat※,lighttpd,php※,resin※ 数据库 ：mysql※,Mysql-proxy,MariaDB，PostgreSQL DB中间件：MyCat,amoeba,MySQL-proxy...
View ArticleClik here to view.
Kudu调研笔记
Goal Kudu 主要面向 OLAP 应用，支持大规模数据存储，支持快速查询，并且支持实时数据更新。相比Hive 之类的SQL on Hadoop，性能会好不少，并且支持数据实时更新，这也是 Hive 的一个痛点；相比于一个传统的 OLAP 数据库，它所支持的数据规模可能要大一点，毕竟 Kudu 是水平扩展的。 Kudu...
View ArticleFront Ends and Extensions Take Hadoop in New Directions
Across the history of data analytics, marquee-level applications have always given rise to useful front ends and connectors that extend what the original applications were capable of. For example, the...
View ArticleClik here to view.
如何在AWS EC2上搭建多可用区域高可用Cassandra集群
本文作者为 Stream 软件架构师Alessandro Pieri。若要详细了解Stream的API可访问他们的 5分钟交互式教程 。 最初由Facebook在2009年开发的 Apache Cassandra 是一种可借助大量服务器处理海量数据，免费开源的分布式数据库引擎。 Stream 使用Cassandra作为信息源（Feed）的主要数据存储。选择Cassandra原因在于它能：...
View ArticleClik here to view.
A Glimpse into Experimentation Reporting at eBay
Around 1500 A/B tests are performed on eBay across different sites and devices on a yearly basis. Experimentation forms a key business process at eBay and plays an important role in the continual...
View Article