数据库常识学习之redis简介
一、redis-cluster架构图 架构细节: (1)所有的redis节点彼此互联(PING-PONG机制),内部使用二进制协议优化传输速度和带宽. (2)节点的fail是通过集群中超过半数的节点检测失效时才生效....
View ArticleNeo4j with Scala: An Awesome Experience withApache Spark [Community Post]
ByAnurag Srivastava, Software Consultant, Knóldus Software | October 25, 2016 [As community content, this post reflects the views and opinions of the particular author and does not necessarily reflect...
View ArticleBI On Hadoop Success: 7 Things To Know
When enterprises implement Hadoop, their top use-case was found to be business intelligence (BI). Now a new benchmark study shows which Hadoop SQL engines are best for which workloads. Here is a look...
View ArticleThe Data Day: October 21, 2016
Nobody understands Data Platforms and Analytics more than I do. Believe me. So sad. Beyond the data lake, @Hortonworks rolls out the data plane https://t.co/L3RHqPv5Cj By @jmscrts ― Matt Aslett...
View ArticleArangoDB Spark Connector
Currently we are diving deeper into the Apache Spark world. We started with an implementation of a Spark-Connector written in Scala. The connector supports loading of data from ArangoDB into Spark and...
View ArticleHadoop mapreduce not working on mac local setup
Yarn jobs hangs on local mac environment Missing node in Resource manager UI There are no nodes in the node list http://localhost:8088/cluster/nodes File: yarn-site.xml...
View ArticleConcurrent inserts and the RocksDB memtable
RocksDB started as a fork of LevelDB. While it will always be a fork, we describe it as derived from LevelDB given how much code has changed. It inherited a memtable that did not allow concurrent...
View ArticleMongoDb学习笔记
mogodb非常占磁盘空间,刚启动就要3-4G左后的空间,虚拟机练习时,可以用--smallfiles选项启动 特点 mongodb 文档数据库 文档(Bson=> json 的二进制化) 内部执行引擎为js解释器,把文档存储为bson结构,查询时转为js对象 在磁盘之上 gridfs 与mysql等传统型数据库相比 传统型数据库 结构化数据 固定的字段 每列的数据类类型是一样的 Mongo...
View ArticleUsing Azure DocumentDB and ASP.NET Core for extreme NoSQL performance
TL;DR:This article continues the journey westarted with Azure DocumentDB. In this installment, we will learn how to build common query patterns and services with ASP.NET Core. A full working...
View ArticleGoogle Pixel Users Reporting Excessive Lens Flare, Software Fix on the Way
Although Google is currently struggling to meet pre-order demand for the Pixel and Pixel XL, those who have managed to get their unit of the devices are reporting an issue with the camera. More...
View ArticleMy First Steps in Exploring RocksDB
RocksDB and storage engine for mysql based on it (so called "MyRocks" ) is widely discussed in my circles since August 2015 at least, so I decided to spend some time checking it. The easy way to get...
View ArticleKong的折腾笔记之相关技术清单
背景 公司准备更好的实现微服务架构,我前期的任务主要是 API 开发相关的技术学习,微服务会随着业务的增加不断增加,客户端调用微服务的 API 也随着增加,这时,一个统一 API 的中间件就有必要了。瞄准了 Kong 这个解决方案,接下来的几天时间就来折腾这个东西。 Kong的基本概念 Kong 是 Mashape 开源的一个 API 中间件项目,基于 Nginx 构建,支持 PostgreSQL...
View ArticleIncremental vs Stream Processing on Hadoop
Companies both large and small benefit from datadriven decisions at every level and many of these decisionscanbenefit from faster data processing.This is especially true for those organizations that...
View ArticleControl Application Downtime with Application Dependency Maps
Application downtime is an enterprise’s worst nightmare. On top of that, it’s fairly common. According to a survey conducted by Dun & Bradstreet, 59 percent of Fortune 500 companies experience a...
View ArticleRedis 哈希(Hash)
Redis hash 是一个string类型的field和value的映射表,hash特别适合用于存储对象。 Redis 中每个 hash 可以存储 232 1 键值对(40多亿)。 实例 redis 127.0.0.1:6379> HMSET w3ckey name "redis tutorial" description "redis basic commands for caching"...
View ArticleQ新闻丨微软开源P语言;Facebook开源JS包管理器Yarn;GitHub采用了新的GraphQL API
“ 开源改变世界,微软、Facebook真乃开源良心。本实习主播稍微剧透一下,1024程序员节,给你看不一样的东西~ NEWS 微软开源P语言,实现安全的异步事件驱动编程 微软最近开源了P语言(https://github.com/p-org/P),致力于在linux、macOS和windows上编写安全的异步事件驱动程序。...
View ArticleGetting started with React/Flux Node/MongoDB Open Source
Almost a year ago I started an ambitious project to create a website from scratch using React and Flux (Redux) as well as Node.js and MongoDB. I was also writing a companion book parallel to writing...
View ArticleCloudant 多租户服务最佳实践
IBM 于 2014 年 2 月收购了 Cloudant,自那以后,事实证明它是一个很有用的基于文档的存储系统。Cloudant 提供了一个直观的仪表板,其中包含许多管理大数据的必要工具和各种各样的客户端库,使得在自己的应用程序中利用 Cloudant 变得很容易。但是,与任何优秀的工具一样,您需要遵守一些最佳实践和避免一些陷阱。...
View ArticleLMDB调研
LMDB中所有的读写都是通过事务来执行,LMDB事务具备以下特点: 支持事务嵌套(??) 读写事务可以并发执行,但写写事务需要被串行化 因此,在lmdb实现中,为了保证写事务的串行化执行,事务执行之前首先要获取全局的写锁。 TxId管理 LMDB中的每个事务都分配唯一的事务编号,且事务编号还需要被持久化。我想这是出于事务的ACID特性考虑。 LMDB中事务实现...
View ArticleIssue 89: The latest Web operations, scaling, and performance news
Be Afraid Of HTTP Public Key Pinning (HPKP) A look at an issue with HTTP Public Key Pinning that made Smashing Magazine unavailable to many visitors for several days. This could affect you too....
View Article