hadoop启动遇到的各种问题
1. HDFS initialized but not 'healthy' yet, waiting... 这个日志会在启动hadoop的时候在JobTracker的log日志文件中出现，在这里就是hdfs出现问题，导致DataNode无法启动，这里唯一的解决方式就是把所有的NameNode管理的路径下的文件删除然后重新执行namenode...
View Articlelearn use Hadoop to creat external table
学习使用Hadoop创建外部表 ## 1. 什么是 Hadoop 简单地来讲，Hadoop是一个能够对大量数据进行分布式处理的软件框架. Hadoop=HDFS（文件系统）+ Mapreduce（数据处理） 2. GPDB如何从HDFS读取数据 通过在location子句中指定主机名和端口号： LOCATION...
View Article[TIL] Cloudera Manager 监控数据的存储
cm 监控数据默认是存储在 /var/lib/ 目录下的，为了避免系统盘空间不够的问题，可以修改 cm 的监控数据配置 Service Monitor 数据存储的配置 Service Monitor存储了时间序列和健康数据，Impla查询的元数据，Yarn应用的元数据。默认情况下，数据时存储在 /var/lib/cloudera-service-monitor/ 目录下，你也可以修改Service...
View ArticleClik here to view.
New in Cloudera Enterprise: Interactive Data Lineage Exploration
Data lineage is an important aspect of establishing trust, and not just for compliance purposes. Things continue to be very busy for theCloudera Navigator team! Just a few weeks ago, as part of the...
View ArticleClik here to view.
Neo4j With Scala : Migrate Data From Other Database to Neo4j
Hello Folks; Lets continue the Neo4j with Scala. We have earlier discuss about the use of Neo4j with Scala and Neo4j APOC with Scala. In this blog we are going to discuss about how we can migrate data...
View ArticleSpring Redis Session配置
<context:property-placeholder location="classpath:config.properties"/> <!-- 单个redis配置 --> <bean...
View ArticleClik here to view.
Hadoop 信息集成平台，让大数据分析更简单！
就本身而言， Hadoop 不是很有用的东西，原因是它需要编写大量复杂和定制的程序代码，难以治理，也没有数据质量概念和数据治理可谈了。企业用户都忙于去研究如何解决使用 Hadoop 所碰到的问题，主要是涉及到项目实施时间、成本和风险等，而 Hadoop 自身的客户化编程就增加了项目实施时间、成本和风险。 大数据项目 实施仅靠 Hadoop...
View ArticleClik here to view.
Redis Sentinel: Make your dataset highly available
In previous blog articles we talked about thebasic Redis features and learned how to persist, backup and restore your dataset in cause of a disaster scenario. Today we want to introduce you to a more...
View ArticleLinux服务器下MariaDB 10自动化安装部署
去MariaDB官网下载MariaDB本文用的是MariaDB 10.1.16https://downloads.mariadb.org选择二进制版本，下载到/root目录下mariadb-10.1.16-linux-x86_64.tar.gz开始安装[root@HE3 ~]# cat mariadb_auto_install.sh######...
View Article详解Redis用链表实现消息队列
前言Redis链表经常会被用于消息队列的服务，以完成多程序之间的消息交换。个人认为redis消息队列有一个好处，就是可以实现分布式和共享，就和memcache作为mysql的缓存和mysql自带的缓存一样。链表实现消息队列Redis链表支持前后插入以及前后取出，所以如果往尾部插入元素，往头部取出元素，这就是一种消息队列，也可以说是消费者/生产者模型。可以利用lpush和rpop来实现。但是有一个问题...
View Articleredis配置认证密码的方法
1.通过配置文件进行配置yum方式安装的redis配置文件通常在/etc/redis.conf中，打开配置文件找到#requirepass foobared 去掉行前的注释，并修改密码为所需的密码,保存文件requirepass myRedis 重启redissudo service redis restart #或者 sudo service redis stop sudo...
View ArticleClik here to view.
MapR stresses stability in naming Oracle veteran Mills as CEO
Big data software vendor MapR Technologies Inc.is putting a 20-year Oracle veteran in charge of its day-to-day operations as it enters the home stretch of what it hopes will be the road to an initial...
View ArticleClik here to view.
Using Open Street Maps and Kalman Filters to Clean Up GPS Data
One of the biggest challenges with continuous location tracking is dealing with volatile quality of smartphone’s GPS readings. Numerous factors affect GPS accuracy such as: Quality of GPS receiver...
View ArticleClik here to view.
Ex-Oracle Exec Is Now CEO of Big Data Firm MapR
One year ago, high-profileOracle executive Matt Mills jumped ship to become president and COO of big data upstart MapR Technologies. On Thursday he officially took over the CEO post, replacing the...
View ArticleClik here to view.
Improving your Azure Redis performance and size with Lz4net
The title is a little misleading. I could rewrite it has improving Redis performance by compressing the object your serialized. It’s not related to Azure Redis particularly, neither to Lz4net which is...
View ArticleReal-World CQRS/ES with ASP.NET and Redis Part 3 - The Read Model
NOTE: This is Part 3 of a five-part series in which I detail how a real-world ASP.NET Web API app using the Command-Query Responsibility Segregation and Event Sourcing (CQRS/ES) patterns and the Redis...
View ArticleClik here to view.
250 GB/day of logs with Graylog: The good, the bad and the ugly
Architecture Graylog Architecture Load Balancer : Load balancer for log input (syslog, kafka, GELF, …) Graylog : Logs receiver and processor + Web interface ElasticSearch : Logs storage MongoDB :...
View ArticleClik here to view.
Apache HBase v1.2.3 发布，分布式数据库
Apache HBase v1.2.3 发布了，HBase 1.2.3是HBase 1.2.x系列中的第三个维护版，在该版本中修复了自1.2.2发行以来的40多个问题，主要更新： *[HBASE-15811] - Batch Get after batch Put does not fetch all Cells *[HBASE-15698] - Increment TimeRange not...
View ArticleClik here to view.
Why you should build your own NoSQL database
If you code for the web, you probably work with databases , which leads you to integrate, setup and most importantly understand how a database works. Let us say at some point your project starts to...
View ArticleUsing Go with Redis
In this demonstration you’ll learn how to use Go with Redis. First and foremost go get garyburd/redigo for connecting with the Redis-server. $ go get github.com/garyburd/redigo Next make sure you have...
View Article