Percona Live featured talk with Mark Callaghan Keynote speaker: RocksDB
Welcome to the next installment of our talks with Percona Live Data Performance Conference 2016 speakers! In this series of blogs, we’ll highlight some of the speakersthat will beat this year’s...
View ArticleRedis 和 I/O 多路复用
最近在看 UNIX 网络编程并研究了一下 Redis 的实现,感觉 Redis 的源代码十分适合阅读和分析,其中 I/O 多路复用(mutiplexing)部分的实现非常干净和优雅,在这里想对这部分的内容进行简单的整理。 几种 I/O 模型 为什么 Redis 中要使用 I/O 多路复用这种技术呢? 首先,Redis...
View ArticleRedisson 2.7.0 和 3.2.0 发布,Redis 客户端
Redisson 2.7.0 和 3.2.0 发布了,Redisson 是基于Redis服务之上构建的分布式、可伸缩的 Java 数据结构,高级的 Redis 客户端。 该版本更新内容如下: 功能: Spring Session implementation Tomcat Session Manager implementation RDelayedQueue object added...
View ArticleMongoDB
没有任何表结构,每条记录的结构可以完全不同 业务开发方便 SQL数据库需要事先定义表结构在使用 完成的索引支持 redis只有key-value,hbase的二级索引还需要自己实现 单键索引,多键索引 数组索引 全文索引 地理位置索引 方便的冗余和扩展 复制集保证数据安全 分片扩展数据规模 良好的支持 完善的文档 齐全的驱动支持 相关工具 MongoDB:64linux...
View ArticleCloudera:智能大数据分析搞定各种复杂应用
【51CTO.com原创稿件】 在云上,最常见的有两种工作状态,一种是上移和转移,就是把以前的工作负载从私有的平台转到云上;另外一种是Cloudera在云上生态的工作负载,在这上面有很多客户大规模的部署。Cloudera在云平台、软件及硬件方面都有很好的生态圈。Cloudera云计算工程副总裁Vikram Makhija在接受本站记者采访时这样表示。 Cloudera用技术解放用户...
View ArticleMongoDB-index
索引:特殊的数据结构,存储表的数据的一小部分以实现快速查询 优点: 1、大大减少了服务器需要扫描的数据量 2、索引可以帮助服务器避免排序或使用临时表 3、索引可以将随机io转换为顺序io 索引评估:三星(非常好) 一星:索引如果能将相关的记录放置到一起 二星:索引中数据的存储顺序与查找标准中顺序一致 三星:如果索引中包含查询中所需要的全部数据:(覆盖索引) DBA书:关系型数据库索引设计与优化...
View ArticleGetting Comfortable with Couchbase Mobile: Couchbase Web Console
Introduction This post marks the second in a series about theCouchbase Mobilestack. You can find the first posthere. It covers installingCouchbase Server. In this post we’ll examine part of Couchbase...
View ArticleAirport AODB goes NoSQL (Part 1)
In previous blog posts I discussed ‘AODB and Big Data‘ and ‘AODB in the Cloud‘. As promised, in this third and largest part of the review, I will look at the NoSQL database approach, design a document...
View ArticleOptimizing the order of MongoDB aggregation steps
MongoDB does have a query optimizer, and in most cases it's effective at picking the best of multiple possible plans. However it's worth remembering that in the case of the aggregate function the...
View ArticleIntegrating Logz.io with PagerDuty & Using Aggregations for Alerts
One of the most popular features Logz.io provides its users with is the built-in alerting mechanism. Coupled with the rich indexing and querying capabilities that are part and parcel ofElasticsearch...
View ArticleThe Future of the DBA
I’ve written beforeabout how databases are like a car engine , and DBAs are like a car mechanic. That’s been the traditional view for production DBAs for, well, forever I think. And that analogy may...
View Article利用MongoDB分析Nginx日志
在项目开发过程中,总是离不开日志解析的工作,虽然有些时候觉得确实挺繁琐的,但是静下心来会发现有时候也是挺有趣的1件工作。 在这里,我们要从日志文件中找出IP访问最多的10条记录,然后判断其是否合法,从而采取对应的措施。 日志解析流程 正常情况下,关于Nginx日志解析的流程如下所示:...
View ArticleThink Big launches consultancy services to generate business value
Think Big Velocity provides an integrated framework to meet the customers’ specific business needs. It delivers end-to-end portfolio of services including a combination of open source technologies...
View ArticleGraph DB + Data Virtualization = Live dashboard for fraud analysis
The scenario Retail banking: Your graph-based fraud detection system powered by Neo4j is being used as part of the controls run when processing line of credit applications or when accounts are...
View ArticleHADOOP与HDFS数据压缩格式
1、 cloudera 数据压缩的一般准则 一般准则 是否压缩数据以及使用何种压缩格式对性能具有重要的影响。在数据压缩上,需要考虑的最重要的两个方面是 MapReduce 作业和存储在 HBase 中的数据。在大多数情况下,每个的原则都类似。 您需要平衡压缩和解压缩数据所需的能力、读写数据所需的磁盘 IO,以及在网络中发送数据所需的网络带宽。正确平衡这些因素有赖于集群和数据的特征,以及您的...
View ArticleHBase启动异常
1 启动异常现象 1)通过hbase shell执行命令,发现处于“Master is initializing”状态。 2)Hbase集群初始化异常,namespace table 和meta table长期处于transition状态。 2016-11-24 13:05:45,738 INFO org.apache.hadoop.hbase.zookeeper.MetaTableLocator:...
View ArticleCoScale 3.2 - Introducing Active Service Checks
With the release of CoScale 3.2 we’ve added a new powerful feature to calculate the uptime and performance of your services. CoScale Active Service Checks are one shot commands that are run every...
View ArticleExport data from MongoDB 3.0 and import it into MongoDB 2.6
I just had the dream meeting with a dockerized app. This is ause-case for containerization. I had to use MongoDB 3.0 to export some data and place it in a 2.6. Ouch: The 2.6 can’t connect to the 3.0....
View ArticleEnabling Legacy Automatic Full Text Search on Neo4j 3.x
Neo4j 3.x has made inroads toward Full Text Search capabilities using Cypher keywords “STARTS WITH”, “ENDS WITH” and “CONTAINS”. However this search capability is limited to a single Schema Index and...
View Article