lc:自带并发控制、服务降级的本地 kv 缓存(Golang)
lc (local cache) Original Intention Compared with lc, only using redis to cache is with these disadvantages such as network overhead, latency increasing dramatically if call repeatedly. In addition,...
View ArticleCome to our booth on DotNext Moscow
This Friday, our team is going to be in DotNext Moscow , showing off RavenDB 4.0 and raffling off some really cool prizes. You can also come and learn optimization techniques that allowed us to get...
View ArticleMongoDB中的数据类型
mongoDB中存储的数据单元被称作文档。文档的格式与JSON很类似,只不过由于JSON表达的数据类型范围太小(null,boolean,numeric,string和object),mongoDB对其做了扩充,并命名为BSON。下面对各个数据类型进行介绍。 null {‘x’: null},数据为空类型 boolean {‘x’: true},数据为布尔类型 number {‘x’:...
View Article姗姗来迟的第四周作业
1、复制/etc/skel目录为/home/tuser1,要求/home/tuser1及其内部文件的属组和其它用户均没有任何访问权限。 [root@www /]# cp -r /etc/skel /home/tuser1 && chmod 700 -R /home/tuser1 [root@www /]# echo $? 0 [root@www home]# ll -al...
View ArticleBig Data Use Cases Real-life Case Studies for Apache Hadoop Spark and Flink
1. Objective In this tutorial we will talk about real-life case studies of Big data, Hadoop, Apache Spark and Apache Flink. This tutorial will brief about the various diverse use cases where industry...
View Articlemongodb架构篇
一、 复制集 Replica set的架构 Replica set的部署 主从操作日志 在local数据库里面:db.oplog.rs.find() 日志的基本信息:db.printReplicationInfo() 查看slave的演示状况:db.printSlaveReplicationInfo() 主从配置信息:db.system.replset.find() 管理replica set...
View Articleexcel数据批量导入mongodb数据库
数据导入数据库的工作经常会遇到,这篇博文我们介绍一下linux系统下如何通过命令将excel中的数据批量导入到非关系型数据库mongodb中。 步骤一:将bigdata.xlsx 另存为 bigdata.csv 步骤二、执行 imongoimport命令之前先进行文件编码转换(防止乱码先将CSV文件编码转为utf-8) iconv -f gbk -t UTF-8 bigdata.csv >...
View ArticleRedis源码剖析--双端链表Sdlist
今天来分析Redis的一个基本数据结构 双端链表,其定义和实现主要在sdlist.h和sdlist.c文件中。其主要用在实现列表键、事务模块保存输入命令和服务器模块,订阅模块保存多个客户端等。 sdlist的数据结构 Redis为双端链表的每一个节点定义了如下的结构体。 // 链表节点定义 typedef struct listNode { struct listNode *prev; //...
View ArticleApache Hadoop 远程权限提升漏洞(CVE-2016-5393)
ApacheHadoop 远程权限提升漏洞(CVE-2016-5393) 发布日期:2016-11-30 更新日期:2016-11-30 受影响系统: Apache Group Hadoop 2.7.x < 2.7.3 描述: CVE(CAN) ID: CVE-2016-5393 Apache Hadoop是支持数据密集型分布式应用并以Apache 2.0许可协议发布的软件框架。...
View ArticleThe Modern Data Architecture in Financial Services
An entire ecosystem of tools and data processing frameworks have grown up around Hadoop. Almost as soon as someone identifies a weakness or limitation―and there have been more than a few―someone else...
View ArticleELT processing with Couchbase and N1QL
Moving data between data sources. This is one of the key activities in data integration projects. Traditionally, techniques around data movement has been part of Data Warehouse, BI and analytics. More...
View ArticleRedis源码剖析--字典dict
字典是Redis中的一个非常重要的底层数据结构,其应用相当广泛。Redis的数据库就是使用字典作为底层实现的,对数据库的增、删、查、改都是建立在对字典的操作上。此外,字典还是Redis中哈希键的底层实现,当一个哈希键包含的键值对比较多,或者键值对中的元素都是比较长的字符串时,Redis就会使用字典作为哈希键的底层实现。...
View ArticleRedis scan命令的一次坑
Redis作为当前服务架构不可或缺的Cache,其支持丰富多样的数据结构,Redis在使用中其实也有很多坑,本次博主遇到的坑或许说是Java程序员会遇到的多一点,下面就听博主详细道来。 线上服务堵塞 String key = keyOf(appid); int retryCount = 3; int socketRetryCount = 3; Exception ex = null;...
View ArticlePost Meta Abuse
Post meta queriesbring down databases, cripple traffic scaling, and dramatically inflate page load times. Thankfully there’s an almost trivial solution. Searching for Meta The problem comes when you...
View Articlesetup gpdb with gphdfs and kerberos in Cloudera VM
Setup gphdfs environment If you need a stand alone hdfs distribution, find the fastest mirror here . If you need a running hdfs service. Please refer to (hdfs)[../1.html] If you need to setup gphdfs...
View ArticleRepresenting The Same Data Structure in SQL and NoSQL (from Classical...
Author: “No Bugs” Hare Follow: Job Title: Sarcastic Architect Hobbies: Thinking Aloud , Arguing with Managers , Annoying HRs , Calling a Spade a Spade , Keeping Tongue in Cheek [[TODO: move this...
View ArticleSecurely signing requests with Rewt
Monday, Dec 5th, 2016 Mixmax is a communications platform that brings email into the 21st century. We believe everything you do today on the web should be possible in any email. This blog post is part...
View ArticleAzure Redis Cache diagnostic improvements
Early next year, we will transition Azure Redis Cache’s telemetry infrastructure to the new Azure Monitor service , thereby enhancing its monitoring and alerting experiences. Customers will enjoy the...
View Article