Typical scenario for Sqoop incremental import and merge
Apache Sqoop is a tool that is designed to efficiently transfer large amounts of data between Apache Hadoop and structured data stores such as relational databases. Sqoop provides an incremental import...
View ArticleCloudera Said to Choose Banks for IPO as Soon as This Year
By Alex Barinka (Bloomberg) ― Cloudera Inc., the big-data company backed by Intel Corp., hired underwriters for an initial public offering that could come as soon as this year, people with knowledge...
View ArticleHadoop 2.2.0 HDFS HA高可用安装与配置
概述 hadoop2.0 已经发布了稳定版本了，增加了很多特性，比如HDFS HA、YARN等。这里我们采用3台虚拟简装安装的Hadoop 2.2.0 版本。 需要注意的是apache提供的hadoop-2.2.0的安装包是在32位操作系统编译的，因为hadoop依赖一些C++...
View ArticleAGPL - what you can do and what you can't
AGPL is a fairly new license that was meant to go GPL-over-networks. However, not being a lawyer, and actually not having read the whole license, I can't understand what exactly you can do freely and...
View ArticlePacker EC2 support and Ansible for our Cassandra Database Clusters
Packer is used to generate machine and container images for multiple platforms from a single source configuration. We use Packer to create AWS EC2 AMIs (images) and Docker images. (We use Vagrant to...
View ArticleUsing AWS CLI to create our Cassandra EC2 instance from custom AMI
Using AWS CLI to create our Cassandra EC2 instance from our custom AMI (Amazon image) Earlier we used packer to create an Amazon Cassandra image - Amazon image (AMI) . Packer installs Cassandra on the...
View ArticleSetting up Ansible for our Cassandra Database Cluster to do DevOps/DBA tasks
Setting up Ansible for our Cassandra Database Cluster to do DevOps/DBA tasks Ansible is an essential DevOps/DBA tool for managing backups and rolling upgrades to the Cassandra cluster in AWS/EC2. An...
View ArticleRedisson 3.3.1 和 2.8.1 发布，Redis 客户端
Redisson 3.3.1 和 2.8.1 发布了。Redisson 是基于Redis服务之上构建的分布式、可伸缩的 Java 数据结构，高级的 Redis 客户端。更新如下： Feature - Cache with SoftReference support added for RLocalCachedMap Feature - Config.subscriptionMode setting...
View ArticleRedis3.0配置文件详解
redis.conf 默认配置文件 #redis.conf # Redis configuration file example. # ./redis-server /path/to/redis.conf ################################## INCLUDES ###################################...
View ArticleClik here to view.
Redis集群单机版搭建
redis 的集群 redis如何进行扩容？ 数据分片如何管理？ 主从复制的读写切换？ 一、 什么是集群 Redis 集群实现了对Redis的水平扩容，即启动N个redis节点，将整个数据库分布存储在这N个节点中，每个节点存储总数据的1/N。 Redis 集群通过分区（partition）来提供一定程度的可用性（availability）： 即使集群中有一部分节点失效或者无法进行通讯，...
View ArticleClik here to view.
Looking Down The Long Enterprise Road With Hadoop
Just five years ago, the infrastructure space was awash in stories about the capabilities cooked into the Hadoop platform―something that was, even then, only a few pieces of code cobbled onto the core...
View ArticleClik here to view.
Redis配置文件理解
Redis配置文件参数说明 redis.conf 配置项说明如下： 1. Redis默认不是以守护进程的方式运行，可以通过该配置项修改，使用yes启用守护进程 daemonize no 2. 当Redis以守护进程方式运行时，Redis默认会把pid写入/var/run/redis.pid文件，可以通过pidfile指定 pidfile /var/run/redis.pid 3....
View ArticleClik here to view.
Redis单机及其集群的搭建
一、单机版redeis 1.安装包下载 http://download.redis.io/releases/ 下载redis的压缩包，并放在/usr/soft文件夹下 2.解压压缩包： tar -zxf redis-3.0.7.tar.gz 3.安装 这里安装redis在/usr/local/redis文件夹中 进入安装包：cd /usr/soft/redis-3.0.7，执行命令 make...
View Article传大数据先锋Cloudera计划今年晚些时候上市
ZD至顶网软件频道消息： 大数据公司Cloudera可能会在今年发布首次公开募股（IPO），之前曾传出Cloudera聘请承销商帮助公司为此举做准备。...
View ArticleRedis 集群节点操作
Redis 集群操作 当前Redis Cluster状态： $ pwd/home/zxm/BD/redis-cluster$ ls -l总用量 32drwxrwxr-x. 2 zxm zxm 4096 8月 24 20:15 7000drwxrwxr-x. 2 zxm zxm 4096 8月 24 20:22 7001drwxrwxr-x. 2 zxm zxm 4096 8月 24 17:32...
View Article【Redis】Java中使用Jedis操作Redis(Maven导入包)、创建Redis连接池
转载请注明出处： http://blog.csdn.net/qq_26525215 本文源自 【 大学之旅_谙忆的博客 】 如果我们使用Java操作Redis， 需要确保已经安装了 redis 服务及 Java redis 驱动。 Maven项目可以直接在pom.xml中加入jedis包驱动: <!--...
View ArticleClik here to view.
UNION重生之架构篇
作者: tiankonguse | 更新日期: 2017-03-06 13:04:00 上篇文章介绍了UNION加了缓存后遇到的问题与优化, 这里是整理一下其中的架构. 零、进化无止境 面对一个问题时, 不管宣称找到如何”完美”的解决方案, 都会引入一系列更”复杂”的问题! 我很喜欢这一句话,因为这一句话是我自己说的. 野蛮时代进入工具时代, 进化的速度加快了, 更多的问题也暴露出来了....
View ArticleClik here to view.
Analyzing RavenDB 4.0 with NDepends
I have a… difficult relationship with NDepends , on the one hand, it is an invaluable tool to provide you with good insight into your project. On the other hand, I don’t always agree with its...
View ArticleCouchbase Developer Release - Put some cURL in your N1QL
What is cURL? Ever heard of cURL? It’s a famous command line tool for sending/receiving data using URL syntax, says wikipedia here . Let’s start with an example related to Couchbase. The N1QL query...
View ArticleFastest way to un-cap a MongoDB capped collection
A couple of weeks agoI converted a mongodb collection to a capped collection. This is for an event archive which we only need to keep the last monthof events stored locally. The issue is that this...
View Article