Tuesday, December 29, 2015

The physical web in smart cities

Namiot D., Sneps-Sneppe M. The physical web in smart cities // Advances in Wireless and Optical Communications (RTUWO), 2015. — Piscataway, NJ, United States: Piscataway, NJ, United States, 2015. — P. 46–49.

In this paper, we discuss the physical web projects based on network proximity for Smart Cities. In general, the Physical Web is an approach for connecting any physical object to the web. With this approach, we can navigate and control physical objects in the world surrounding mobile devices. Alternatively, we can execute services on mobile devices, depending on the surrounding physical objects. Technically, there are different ways to enumerate physical objects. In this paper, we will target the models based on the wireless proximity.

Sunday, December 13, 2015

DAMDID/RCDL 2015

DAMDID/RCDL 2015 - Data Analytics and Management in Data Intensive Domains

Wednesday, December 09, 2015

Info-bots in Twitter

Our paper in AINL-FRUCT: Twitter as a transport layer platform

Internet messengers and social networks have become an integral part of modern digital life. We have in mind not only the interaction between individual users but also a variety of applications that exist in these applications. Typically, applications for social networks use the universal login system and rely on data from social networks. Also, such applications are likely to get more traction when they are inside of the big social network like Facebook. At the same time, less attention is paid to communication capabilities of social networks. In this paper, we target Twitter as a messaging system at the first hand. We describe the way information systems can use Twitter as a transport layer for own services. Our work introduces a programmable service called 411 for Twitter, which supports user-defined and application-specific commands through tweets.

Wednesday, November 25, 2015

Markov Chains

A great explanation: Understanding Markov Chains

See here more publications about Markov Chains

Monday, November 23, 2015

Friday, November 20, 2015

Mining Groups of Mobile Users

A new paper: Mining Groups of Mobile Users in Int. J. of Wireless and Mobile Computing, 2015 Vol.9, No.3, pp.211 - 217

Monday, November 02, 2015

EmTech 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is EmTech symposium, MIT, Cambridge 2015

Twitter Live Feed: Emtech 2015

/via Bluetooth Data Points

Thursday, October 29, 2015

Data mining first aid

Here is a list of statistical and machine learning concepts that are in every data scientist’s toolbox.

Wednesday, October 21, 2015

On hyper-local web pages

Network proximity and web. How to access to wireless tags from web?


Monday, October 19, 2015

The Physical Web in Smart Cities

Our new paper for RTUWO conference: Dmitry Namiot, Manfred Sneps-Sneppe "The Physical Web in Smart Cities"

In this paper, we discuss the physical web projects based on network proximity for Smart Cities. In general, the Physical Web is an approach for connecting any physical object to the web. With this approach, we can navigate and control physical objects in the world surrounding mobile devices. Alternatively, we can execute services on mobile devices, depending on the surrounding physical objects. Technically, there are different ways to enumerate physical objects. In this paper, we will target the models based on the wireless proximity.

Monday, October 12, 2015

Sunday, September 27, 2015

Network Proximity for Content Discovery

Our new paper: I. D. Yousef and D. Namiot, “Network proximity for content discovery,” International Journal of Interactive Mobile Technologies (iJIM), vol. 9, no. 4, pp. 42–48, 2015.

The paper describes our approach for using wireless sensors on mobile phones for delivering new data to mobile subscribers. We propose a new practical approach for social context-aware data retrieval based on mobile phones as a sensor concept. This approach uses Wi-Fi and Bluetooth modules located on mobile phones as sensors for getting proximity information that can open (discover) access to any user-generated content or content published in the social networks. A special mobile service (context-aware browser client for Android) can present that information to mobile subscribers. The potential use-cases for the proposed approach include all projects associated with hyper-local news data. For example, news services in Smart City projects, proximity marketing, indoor data delivery, etc.

Saturday, September 26, 2015

Meta-Data in SDN API

Our new paper: M. Sneps-Sneppe and D. Namiot, “Metadata in sdn api for wsn,” in New Technologies, Mobility and Security (NTMS), 2015 7th International Conference on, pp. 1–5, IEEE Paris, France, 2015.

This paper discusses the system aspects of the development of applied programming interfaces in Software-Defined Networking (SDN). SDN is a prospect software enablement for Wireless Sensor Networks (WSN). So, application layer SDN API will be the main application API for WSN. Almost all existing SDN interfaces use so-called Representational State Transfer (REST) services as a basic model. This model is simple and straightforward for developers, but often does not support the information (metadata) necessary for programming automation. In this article, we cover the issues of representation of metadata in the SDN API.

Friday, September 25, 2015

On events recognition in optical sensing systems

Aleksey Fedorov, Maxim Anufriev, Andrey Zhirnov, Konstantin Stepanov, Evgeniy Nesterov, Dmitry Namiot, Valery Karasik, Alexey Pnev "Gaussian mixture model for events recognition in optical time-domain reflectometry based sensing systems"

The novel approach for recognition of particular classes of non-conventional events in signals from phase-sensitive optical time-domain reflectometry is proposed. The proposed algorithmic solution is based on the adaptive filtering for de-nosing of signals and Gaussian Mixture Model with the feature space formed by the cepstral coefficients for their clustering. We use experimentally measured signals from phase-sensitive optical time-domain reflectometry based sensing systems for evidence of the suggested algorithm. Our results show that two classes of events can be detected and distinguished between two classes with the probability being close to 0.9. Proposed algorithmic solution can be used in real-time distributed fiber optic sensing systems for control of protected areas.

Thursday, September 24, 2015

Twitter as a transport in information systems

Dmitry Namiot "Twitter as a Transport Layer Platform"

Internet messengers and social networks have become an integral part of modern digital life. We have in mind not only the interaction between individual users but also a variety of applications that exist in these applications. Typically, applications for social networks use the universal login system and rely on data from social networks. Also, such applications are likely to get more traction when they are inside of the big social network like Facebook. At the same time, less attention is paid to communication capabilities of social networks. In this paper, we target Twitter as a messaging system at the first hand. We describe the way information systems can use Twitter as a transport layer for own services. Our work introduces a programmable service called 411 for Twitter, which supports user-defined and application-specific commands through tweets.

Sunday, September 20, 2015

To Deep or not to Deep

An interesting discussion: Will deep learning make other Machine Learning algorithms obsolete?

Our own answer - No. Very often, simpler algorithms like logistic regression will work fine. Deep Learning success depends on the data volume. It should be huge and it is not always true.

Tuesday, September 15, 2015

Monday, September 14, 2015

LSTM Networks

A good technical paper: Long Short Term Memory networks – usually just called “LSTMs” – are a special kind of RNN, capable of learning long-term dependencies.

Thursday, August 20, 2015

On JavaScript memory management

Please, vode for our presentation on JavaScript memory management. We will publish it here after the conference.

Introduction to Markov chain

Markov chain is based on a principle of “memorylessness”. In other words the next state of the process only depends on the previous state and not the sequence of states. This simple assumption makes the calculation of conditional probability easy and enables this algorithm to be applied in number of scenarios. In this article, we will restrict ourself to simple Markov chain. - from here

Tuesday, August 04, 2015

INJOIT vol. 3, no. 8

International Journal of Open Information Technologies has just published its latest issue at http://injoit.org. We invite you to review the Table of Contents here and then visit our web site to review articles and items of interest.

International Journal of Open Information Technologies Vol 3, No 8 (2015)

Table of Contents

Applied mathematics

Intensification of search domain contraction in non-uniform covering method (1-7)

Modern programming issues

The case tool for software structure and metrics visualization in 3D space (8-16)

Telecommunication technologies and computer networks

On Model of Information System Based on push-notifications (17-29)
Control of transport routes via mobile phones (30-39)
On telecom services and the DISN evolution (40-47)

Big data and their applications

On Big Data Stream Processing (48-51)

Sunday, July 26, 2015

Introduction to Monte-Carlo

The idea of Monte Carlo methods is this—generate some random samples for some random variable of interest, then use these samples to compute values you’re interested in.

Friday, July 17, 2015

On Mobile Wireless Tags

Namiot D., Sneps-Sneppe M. On mobile wireless tags // Automatic Control and Computer Sciences. — 2015. — Vol. 49, no. 3. — P. 159–166.

The subject of the article refers to services of mobile networks related to a context. We are examining the questions of the development of mobile services employing wireless tags. In addition to this, a new model of usage (application) of Core Bluetooth devices is offered. In our model Bluetooth devices act as tags and are used for reference (binding) and the subsequent context-dependent determination of data available to mobile users. Mobile phones, as well as already existing devices with Bluetooth support, can be used as such dynamic tags. In this case a single mobile application is sufficient for coverage of all stages of the life cycle of contextual services. The application provides a presentation of a tag (tags) and the binding of informational content to these tags, as well as the viewing of data bound to other tags. The possible application fields are applications for retail and service organizations and context-dependent services for Smart Cities. DOI

Monday, July 06, 2015

INJOIT - call for paper

The International Journal of Open Information Technologies (INJOIT) is an all-electronic journal with the aim to bring the most recent and unpublished research and development results in the area of information technologies to the scientific and technical societies. Free, peer reviewed papers. English or Russian languages. It is free to publish your paper.

The journal is published by the OIT Lab (Open Information Technologies Lab, Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University).

Indexing: Google Scholar, DOAJ, Ulrich's Periodicals Directory, ResearchBib, Elibrary.ru (RINC)

See also our archive

Friday, July 03, 2015

Memory leaks in JavaScript

Our new paper: Evgeniy Ilyushin, Dmitry Namiot "On JavaScript Memory Leaks". International Journal of Open Information Technologies 3.7 (2015): 27-31.

As soon as more and more the modern applications are deployed on the web, JavaScript has become a mainstream programming environment. JavaScript applications nowadays are big programming systems. We can mention here web portals, online games, graphics, media management, and even data science. Of course, the memory management is a very important problem, especially, for the dynamic programming languages. In this paper, we provide a survey of memory leaks patterns in JavaScript.

Thursday, June 25, 2015

GeoInt 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is GeoInt symposium, Washington, DC 2015

Twitter Live Feed: GeoInt Congress 2015

/via Bluetooth Data Points

Tuesday, June 09, 2015

Network Proximity in Web Applications

Our new paper: Dmitry Namiot, Manfred Sneps-Sneppe "On Network Proximity in Web Applications"

In this paper, we discuss one approach for development and deployment of web sites (web pages) devoted to the description of objects (events) with a precisely delineated geographic scope. This article describes the usage of context-aware programming models for web development. In our paper, we propose mechanisms to create mobile web applications which content links to some predefined geographic area. The accuracy of such a binding allows us to distinguish individual areas within the same indoor space. Target areas for such development are applications for Smart Cities and retail.

Wednesday, June 03, 2015

LBS Event


We continue to share links for monitoring the interesting events in Twitter. Now it is LBS Event, London 2015

Twitter Live Feed: LBS Event 2015

/via Bluetooth Data Points

Saturday, May 30, 2015

Data Science Books

27 free Data Mining books

We would like one more: Statistics Done Wrong is a guide to the most popular statistical errors and slip-ups committed by scientists every day, in the lab and in peer-reviewed journals. Many of the errors are prevalent in vast swaths of the published literature, casting doubt on the findings of thousands of papers. Statistics Done Wrong assumes no prior knowledge of statistics, so you can read it before your first statistics course or after thirty years of scientific practice.

See here more free Data Science books

Wednesday, May 06, 2015

Geo-location for Telecom Operators

Our new paper: Dmitry Namiot, Manfred Sneps-Sneppe "On Geo Location Services for Telecom Operators"

This paper presents location based service for telecom providers. Most of the location-based services in the mobile networks are introduced and deployed by Internet companies. It leaves for telecom just the role of the data channel. Telecom providers should use their competitive advantages and offer own solutions. In this paper, we discuss the sharing location information via geo-messages. Geo messages let mobile users share location information as signatures to the standard messages (e.g., email, SMS). Rather than let some service constantly monitor (poll) the user location (as the most standalone services do) or share location info within any social circle (social network check-in, etc.) The Geo Messages approach lets users share location data on the peer to peer basis. Users can share own location info with any existing messaging systems. And messaging (e.g., SMS) is the traditional service for telecom.

Friday, April 24, 2015

Bluetooth Data Points

Our presentation for FRUCT conference. Bluetooth devices as mobile tags.

You can read the paper here.

Sunday, April 19, 2015

On Probability

The Only Probability Cheatsheet You'll Ever Need. 8 pages about probability

Tuesday, April 07, 2015

Statistics about Big Data

10 things statistics taught us about big data analysis. A great read.

Btw, if you need just one rule about data analysis, then it is very simple: "plot your data".

Tuesday, March 31, 2015

On Mobile Mesh Networks

With the advances in mobile computing technologies and the growth of the Net, mobile mesh networks are going through a set of important evolutionary steps. In this paper, we survey architectural aspects of mobile mesh networks and their use cases and deployment models. Also, we survey challenging areas of mobile mesh networks and describe our vision of promising mobile services. This paper presents a basic introductory material for Masters of Open Information Technologies Lab, interested in modern mobile services.

Read the paper.

Tuesday, March 24, 2015

Metadata in SDN API

Our paper in arxiv: Dmitry Namiot, Manfred Sneps-Sneppe "Metadata in SDN API"

This paper discusses the system aspects of development of applied programming interfaces in Software-Defined Networking (SDN). Almost all existing SDN interfaces use so-called Representational State Transfer (REST) services as a basic model. This model is simple and straightforward for developers, but often does not support the information (metadata) necessary for programming automation. In this article, we cover the issues of representation of metadata in the SDN API.

Thursday, March 05, 2015

On Indoor Positioning

A new paper: Namiot, Dmitry. "On Indoor Positioning." International Journal of Open Information Technologies 3.3 (2015): 23-26.

This paper presents the survey of the modern indoor positioning technologies and systems. We discuss Wi-Fi and Bluetooth based positioning systems, light-based and magnetic field systems. It is our first attempt to classify indoor positioning techniques. We try to highlight the advantages and disadvantages of various indoor positioning technologies and systems, compare their accuracy, applicability, working principles and performance parameters.

Monday, March 02, 2015

4YFN


We continue to share links for monitoring the interesting events in Twitter. Now it is 4 Years From Now, Barselona 2015

Twitter Live Feed: 4YFN 2015

/via Bluetooth Data Points

Wednesday, February 25, 2015

Activity Monitoring

Manfred Sneps-Sneppe, Dmitry Namiot "Smart Socket for Activity Monitoring"

In this short paper we consider the problem of monitoring physical activity in the smart house. The authors suggested a simple device that allows medical staff and relatives to monitor the activity for older adults living alone. This sensor monitors the switching-on of electrical devices. The fact of switching is seen as confirmation of physical activity. It is confirmed by SMS notifications to observers.

Thursday, February 19, 2015

On Mobile Bluetooth Tags

Dmitry Namiot, Manfred Sneps-Sneppe "On Mobile Bluetooth Tags"

This paper presents a new approach for hyper-local data sharing and delivery on the base of discoverable Bluetooth nodes. Our approach allows customers to associate user-defined data with network nodes and use a special mobile application (context-aware browser) for presenting this information to mobile users in proximity. Alternatively, mobile services can request and share local data in M2M applications rely on network proximity. Bluetooth nodes in cars are among the best candidates for the role of the bearing nodes.

StrataHadoop 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is Strata + Hadoop World, San Jose 2015

Twitter Live Feed: StrataHadoop 2015

/via Bluetooth Data Points

Thursday, February 12, 2015

INJOIT CFP

The International Journal of Open Information Technologies (INJOIT) is an all-electronic journal with the aim to bring the most recent and unpublished research and development results in the area of information technologies to the scientific and technical societies. Free, peer reviewed papers. English or Russian languages. It is free to publish your paper.

The journal is published by the OIT Lab (Open Information Technologies Lab, Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University).

Indexing: Google Scholar, DOAJ, Ulrich's Periodicals Directory, ResearchBib, Elibrary.ru (RINC)

See also our archive

Startup Europe Summit 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is Startup Europe Summit, Berlin 2015

Twitter Live Feed: Startup Europe Summit 2015

/via Bluetooth Data Points

Friday, February 06, 2015

Loca 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is Loca Conference, Munich 2015

Twitter Live Feed: Loca 2015

/via Bluetooth Data Points

Sunday, February 01, 2015

Forecasting: principles and practice

Free textbook on forecasting. This textbook is intended to provide a comprehensive introduction to forecasting methods and to present enough information about each method for readers to be able to use them sensibly.

Thursday, January 29, 2015

ConnecteDriver 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is ConnecteDriver, Brussels 2015

Twitter Live Feed: ConnecteDriver 2015

/via Bluetooth Data Points

Tuesday, January 27, 2015

On Geo Signatures

Namiot, D. (2015). Geo Signature and its applications. International Journal of Information Science and Intelligent System, 4(1), 105-118.

This paper summarizes definitions and uses cases for the sharing location information via geo messages. Geo messages let users of location based systems share location information as signatures to the standard messages (e.g., email, SMS).

Monday, January 26, 2015

Friday, January 23, 2015

Learn Data Science

A really nice project: Learn data science in your browser. It is free and even no registration required.

Monday, January 19, 2015

DLD 2015


We continue to share links for monitoring the interesting events in Twitter. Now it is DLD Conference, Munich 2015

Twitter Live Feed: Munich 2015

/via Bluetooth Data Points

Friday, January 16, 2015

Cars as Tags

Our new paper:

Namiot, D., & Sneps-Sneppe, M. (2014, October). CAT??? cars as tags. In Communication Technologies for Vehicles (Nets4Cars-Fall), 2014 7th International Workshop on (pp. 50-53). IEEE.

This paper presents a new approach for hyperlocal data sharing and delivery on the base of discoverable Bluetooth nodes. Our approach allows customers to associate user-defined data with network nodes and use a special mobile application (context-aware browser) for presenting this information to mobile users in proximity. Alternatively, mobile services can request and share local data in M2M applications rely on network proximity. Bluetooth nodes in cars are among the best candidates for the role of the bearing nodes.

P.S. You can see also our presentation

Friday, January 09, 2015

Machine Learning ebooks

Free ML ebooks:

1. The LION Way: Machine Learning plus Intelligent Optimization

Author/s: Roberto Battiti, Mauro Brunato
Publisher: Lionsolver, Inc., 2013

Learning and Intelligent Optimization (LION) is the combination of learning from data and optimization applied to solve complex problems. This book is about increasing the automation level and connecting data directly to decisions and actions.

2. A Course in Machine Learning

Author/s: Hal Daumé III
Publisher: ciml.info, 2012

This is a set of introductory materials that covers most major aspects of modern machine learning (supervised and unsupervised learning, large margin methods, probabilistic modeling, etc.). It's focus is on broad applications with a rigorous backbone.

3. A First Encounter with Machine Learning

Author/s: Max Welling
Publisher: University of California Irvine, 2011

The book you see before you is meant for those starting out in the field of machine learning, who need a simple, intuitive explanation of some of the most useful algorithms that our field has to offer. A prelude to the more advanced text books.

4. Bayesian Reasoning and Machine Learning

Author/s: David Barber
Publisher: Cambridge University Press, 2011

The book is designed for final-year undergraduate students with limited background in linear algebra and calculus. Comprehensive and coherent, it develops everything from basics to advanced techniques within the framework of graphical models.

5. Introduction to Machine Learning

Author/s: Amnon Shashua
Publisher: arXiv, 2009

Introduction to Machine learning covering Statistical Inference (Bayes, EM, ML/MaxEnt duality), algebraic and spectral methods (PCA, LDA, CCA, Clustering), and PAC learning (the Formal model, VC dimension, Double Sampling theorem).

6. The Elements of Statistical Learning: Data Mining, Inference, and Prediction

Author/s: T. Hastie, R. Tibshirani, J. Friedman - Springer, 2009
This book brings together many of the important new ideas in learning, and explains them in a statistical framework. The authors emphasize the methods and their conceptual underpinnings rather than their theoretical properties.

7. Reinforcement Learning

Author/s: C. Weber, M. Elshaw, N. M. Mayer
Publisher: InTech, 2008

This book describes and extends the scope of reinforcement learning. It also shows that there is already wide usage in numerous fields. Reinforcement learning can tackle control tasks that are too complex for traditional controllers.

8. Machine Learning

Author/s: Abdelhamid Mellouk, Abdennacer Chebira
Publisher: InTech, 2009

Neural machine learning approaches, Hamiltonian neural networks, similarity discriminant analysis, machine learning methods for spoken dialogue simulation and optimization, linear subspace learning for facial expression analysis, and more.

9. Reinforcement Learning: An Introduction

Author/s: Richard S. Sutton, Andrew G. Barto
Publisher: The MIT Press, 1998

The book provides a clear and simple account of the key ideas and algorithms of reinforcement learning. It covers the history and the most recent developments and applications. The only necessary mathematical background are concepts of probability.

10. Gaussian Processes for Machine Learning

Author/s: Carl E. Rasmussen, Christopher K. I. Williams
Publisher: The MIT Press, 2005

Gaussian processes provide a principled, practical, probabilistic approach to learning in kernel machines. The treatment is comprehensive and self-contained, targeted at researchers and students in machine learning and applied statistics.

11. Machine Learning, Neural and Statistical Classification

Author/s: D. Michie, D. J. Spiegelhalter
Publisher: Ellis Horwood, 1994

The book provides a review of different approaches to classification, compares their performance on challenging data-sets, and draws conclusions on their applicability to realistic industrial problems. A wide variety of approaches has been taken.

12. Introduction To Machine Learning

Author/s: Nils J Nilsson, 1997
This book concentrates on the important ideas in machine learning, to give the reader sufficient preparation to make the extensive literature on machine learning accessible. The author surveys the important topics in machine learning circa 1996.

13. Inductive Logic Programming: Techniques and Applications

Author/s: Nada Lavrac, Saso Dzeroski
Publisher: Prentice Hall, 1994

This book is an introduction to inductive logic programming. It covers empirical inductive logic programming with applications in knowledge acquisition, inductive program synthesis, inductive data engineering, and knowledge discovery in databases.

14. Practical Artificial Intelligence Programming in Java

Author/s: Mark Watson
Publisher: Lulu.com, 2008

The book uses the author's libraries and the best of open source software to introduce AI (Artificial Intelligence) technologies like neural networks, genetic algorithms, expert systems, machine learning, and NLP (natural language processing).

15. Information Theory, Inference, and Learning Algorithms

Author/s: David J. C. MacKay
Publisher: Cambridge University Press, 2003

A textbook on information theory, Bayesian inference and learning algorithms, useful for undergraduates and postgraduates students, and as a reference for researchers. Essential reading for students of electrical engineering and computer science.


INJOIT - call for papers

The International Journal of Open Information Technologies (INJOIT) is an all-electronic journal with the aim to bring the most recent and unpublished research and development results in the area of information technologies to the scientific and technical societies. Free, peer reviewed papers. English or Russian languages. It is free to publish your paper.

The journal is published by the OIT Lab (Open Information Technologies Lab, Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University).

Indexing: Google Scholar, DOAJ, Ulrich's Periodicals Directory, ResearchBib, Elibrary.ru (RINC)

See also our archive

Monday, January 05, 2015

More about Time Series Databases

An actual question in connection with M2M and Smart Cities tasks - Open source databases for time-series, events and metrics. E.g.:

What is else?

Sunday, January 04, 2015

Cold emails

A great story about cold emails. And about a great product too.