Big Data Collection Procedure for On-site Monitoring System of Smart Community with PV Microgrid
Keywords:
Community, Microgrid, Energy DatabaseAbstract
Energy data such as energy consumption from buildings and energy production from distributed generations are very important to determine the optimal sizing, design and configuration of renewable energy-based microgrid systems for a smart community. The main goal of this research is to develop an energy data collection and processing system for the large and complex energy data set generated by a PV-based micro grid powering a Smart Community. Data collected include direct and indirect energy data. Direct energy data for this work are direct energy data which covers energy consumption from buildings located in the model Smart Community, and energy generation data from the PV systems. Indirect energy data include data that affect energy consumption, such as; water usage, indoor temperature, humidity and waste generation. The data collected from sensors installed in the buildings were then processed through three steps: capture, verification and arrangement. Approximately 1,800 data files per month were processed and each data file has the maximum of 86,400 data records depending on the data category and collection interval. The installed sensors in real buildings faced several challenges such interruptions of data transmission due to blackouts, and sensor malfunctions from animals and insects tripping the devices. The data verification was demnostrated to be a very important part to screen the usable data and reject the bad ones. The processed data were then imported into the energy data management system database. The database was developed with MySQL program to systematically grouped and arranged the data in their category. The MySQL database could be integrated with other tools to conveniently manage and report large quantity of data. This big energy data collection and processing procedure, with an easy-to-understand reporting format can be applied to any energy data management system for any real-world, although small community.
References
[2] Jin, S., & Chassin, D.P. (2014). Thread Group Multithreading: Accelerating the computation of an Agentbased Power System Modeling and Simulation Tool – GridLAB-D, in International Conference on System Science. Hawaii.
[3] Barnes, M. (2007). Real-World MicroGrids-An Overview. in System of Systems Engineering, 2007. SoSE '07. IEEE International Conference.
[4] Hatziargyriou, N. (2007). Microgrids. Power and Energy Magazine, IEEE, 5(4), 78-94.
[5] Mohanty, S. (2016). Everything You Wanted to Know About Smart Cities, 5, 60-70.
[6] Taylor-Sakyi, K.(2016). Big Data: Understanding Big Data.
[7] Y, X.U. (2015). Knowledge Management in Big Data Times. in 2015 IEEE Fifth International Conference on Big Data and Cloud Computing.
[8] Data cleansing, National Science and Technology Development Agency. (2012). Retrieved from https://www.nstda.or.th/th/nstda-knowledge/2910-data-cleaning
[9] Mithani, F., Machchhar, S., & Jasdanwala, F. (2016). A novel approach for SQL query optimization. Paper presented at the 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC).
Downloads
Published
How to Cite
Issue
Section
License
All copyrights of the above manuscript, including rights to publish in any media, are transferred to the SGtech.
The authors retain the following rights;
1. All proprietary rights other than copyright.
2. Re-use of all or part of the above manuscript in their work.
3. Reproduction of the above manuscript for author’s personal use or for company/institution use provided that
(a) prior permission of SGtech is obtained,
(b) the source and SGtech copyright notice are indicated, and
(c) the copies are not offered for sale.
