Top 5 SQL Server Books for the DBA
The Top 5 series has proved rather popular. My Top 5 books for Enterprise Architecture was the most popular post in the last month. With this in mind I have a little series of my top 5 books on...
View ArticleOpenShift Ecosystem: Unleashing MongoDB with your OpenShift Applications
Overview Current development cycles face many challenges such as an evolving landscape of application architecture (Monolithic to Microservices), the need to frequently deploy features, and new IaaS...
View Article分布式一致性算法Raft详解
分布式存储系统通常通过维护多个副本来进行fault-tolerance,提高系统的availability,带来的代价就是分布式存储系统的核心问题之一:维护多个副本的一致性。一致性协议就是用来干这事的,即使在部分副本宕机的情况下。Raft是一种较容易理解的一致性协议。一致性协议通常基于replicated state...
View Article马哥教育N22期第四周作业
1、复制/etc/skel目录为/home/tuser1,要求/home/tuser1及其内部文件的属组和其它用户均没有任何访问权限。 root@xuc-virtual-machine:/home/xuc# cp -r /etc/skel/ /home/tuser1root@xuc-virtual-machine:/home# chmod 700...
View ArticleMunich Re achieves strategic big data platform with SAS and Hortonworks
Munich Re, the world’s largest reinsurer, is relying on SAS Analytics and Hortonworks Data Platform (HDP) for its big data initiative. Together with its technology partners, the reinsurer has...
View Article一种基于Redis的10行代码实现IP频率控制方法
优点:可支持海量访问的频率控制,只需要增加Redis机器,单个Redis节点(只占用一个cpu core)即可支持6万/s以上的处理。 基于IP频率限制是种常见需求,基于Redis可以十分简单实现对IP的频率限制,具体手段为利用Redis的key过期和原子加减两个特性。 以IP作为key,频率为key过期时长,比如限制单个IP在2秒内频率为100,则key过期时长为2秒,基于 r3c (a...
View ArticleTuning the RocksDB block cache
I spent many years using InnoDB with direct IO and I didn't worry about buffered IO performance. Well, I didn't worry until Domas told me to worry. My focus has switched to RocksDB and now I worry...
View ArticleSimplifying Cassandra Heap Size Allocation
As discussedpreviously, Knewton has a large Cassandra deployment to meet its data store needs. Despite best efforts to standardize configurations across the deployment, the systems are in a...
View ArticleLog Buffer #488: A Carnival of the Vanities for DBAs
This Log Buffer Edition picks few of the blog posts fromOracle, SQL Server andmysql. Oracle: Login with OAuth2.0 using AngularJS 1.5 componentrouter and Node Despite web pages having been around for...
View Article单日峰值 2T 发送量邮件营销平台实践经验
作者: 刘锟洋,独立博主,系统架构师。就职于京东成都研究院,做过A/B Test,精准营销平台,会员营销平台。公司内部开源小组发起人,内部开源过多个开源项目,对性能全链路优化和分布式服平台有浓厚兴趣。笔者博客:http://www.liuinsect.com/。 EDM简介 EDM 是 Email DirectMarketing...
View Article唯品会多线程redis设计与实现|Redis中国用户组
作者:申政,开源爱好者,唯品会高级DBA,主要负责Redis相关领域的源码研究和研发工作。 开源项目: redis cluster的C客户端(hiredis-vip) 集群迁移工具(redis-migrate-tool) 多线程版Twemproxy(Twemproxies)...
View ArticleInfluxDB vs. Cassandra for timeseries data
This is the secondin a series of detailed benchmarking tests comparing InfluxDB vs Elasticsearch, Cassandra, MongoDB and other databases for time-series data and metrics workloads. At InfluxData, one...
View Article在windows环境下实现mysql的读写分离和负载均衡
1.前(jian)言(tao):明明上星期就弄好了,然而拖到了今天才来写博客纪录,拖延症晚期的我。2.实现mysql的读写分离(1)基本的理论知识:首先,要实现mysql的读写分离,可以使用mysql的主(master)从(slave)复制(Replication)来实现: 主(master)库只提供写数据的服务,而从(slave)库只提供读数据的服务。 什么是主从复制?...
View Article商务智能BI--ETL知识
一、ETL在数据仓库中的地位ETL是数据仓库项目中最艰难且耗时最长的工作,ETL系统的设计和开发工作对商务智能项目的成败产生至关重要的影响,如果把数据仓库项目看成一座大厦的话,那么建筑图样规划就是数据仓库模型的设计过程,根据图样建造宫殿的过程就是ETL设计开发的过程,而那座美丽的宫殿就是数据仓库的成果。作为从事商务智能的专业人士,需要真真正正理解ETL理论方面的知识,而不仅仅停留在ETL工具的使用上...
View ArticleSQL versus NoSQL databases
I recently saw an Information Management To-Be Architecture Overview diagram at a client. It has clearly depicted the current landscape for the Relational Database side. Then came the surprise, a...
View Article[译] 如何编写可维护的集成测试
原文: Writing Maintainable Integration Tests 译者:杰微刊兼职翻译王强 在软件开发行业,集成测试的编写某种程度上是最不受重视的工作。很多人仅仅会考虑单元测试项目,更多人可能根本没想过用自动化测试方法。编写一套可维护、可管理、可扩展的集成测试对大多数开发者来说是非常陌生的。...
View ArticleDBA Days: Killing TempDB softly
Don’t make me regret publishing this This really will take a server down immediately. You can restart it, as we learned during DBA Days, but… If you also go ahead and make this an Agent job that runs...
View ArticleWhat’s New in SmartSense 1.3
This April, Hortonworks launched a multi-phase initiative to streamline Apache Hadoop operations , and the 1.3 release of SmartSense marks the delivery of the second phase of that initiative, and that...
View ArticleHadoop Summit Melbourne shows how data is transforming the world
I just left a sold-out Melbourne Hadoop Summit 2016 in Australia. This was the first Summit in Asia Pacific and I was excited by tremendous response from the global and local community, and from...
View Article