Development of a Community Data Platform for Analytics and Management Planning

Main Article Content

Sunisa Junrat
Jirasak Nopparat
Mongkon Manopiroonporn
Wannarat Suntiamorntut
Sakuna Charoenpanyasak

Abstract

Data from each community comprises various categories, influenced by factors such as community condition, climate, lifestyle, culture, local cuisine, plant types, and businesses. Most of this data has not been stored digitally. Analyzing data from individual communities, sub-districts, provinces, and on a national scale can be delayed and incomplete. Some of the data that was previously stored digitally are in separate, scattered, and unconnected storage systems. As a result, managing this data collectively is challenging. This study proposes the design and development of a community data platform for analytics and management planning. The platform supports storing diverse data types such as text, numbers, locations, dates, times, images, and documents. It can link data from other existing systems through defined APIs and stores raw data on Google Firebase Firestore, files on Google Cloud Storage, and data for quick retrieval on Elasticsearch. Furthermore, the platform includes the design and development of applications to record various data categories for each community. It supports the automatic creation of data structures for each data category to make data collection by community members more convenient. The design and development of this multi-data management system allow for flexible gathering of different types of data from each community. As a result, it can be used to address problems and develop cities as desired.

Article Details

Section
Research Article

References

D. Jacobson, G. Brail, and D. Woods, APIs: A Strategy Guide. Sebastopol, CA, USA: O’Reilly Media, 2012.

Cloud Firestore. (2023). Firebase. Accessed: Dec. 19, 2023. [Online]. Available: https://firebase.google.com/docs/firestore

Cloud Storage documentation. (2023). Google Cloud. Accessed: Dec. 19, 2023. [Online]. Available: https://cloud.google.com/storage/docs

Elasticsearch Platform — Find real-time answers at scale | Elastic. (2023). Elasticsearch. Accessed: Dec. 21, 2023. [Online]. Available: https://www.elastic.co

H. S. Munawar, S. Qayyum, F. Ullah, and S. Sepasgozar, “Big data and its applications in smart real estate and the disaster management life cycle: A systematic analysis,” Big Data Cogn. Comput., vol. 4, no. 2, 2020, Art. no. 4, doi: 10.3390/bdcc4020004.

J. Vodák, D. Šulyová, and M. Kubina, “Advanced technologies and their use in smart city management,” Sustainability, vol. 13, no. 10, Jan. 2021, Art. no. 10, doi: 10.3390/su13105746.

M. Ku and J. R. Gil-Garcia, “Ready for data analytics?: Data collection and creation in local governments,” in Proc. 19th Annu. Int. Conf. Digit. Government Res.: Governance in Data Age, Delft, Netherlands, May 2018, pp. 1–10.

U. Aftab and G. F. Siddiqui, “Big data augmentation with data warehouse: A survey,” in Proc. 2018 IEEE Int. Conf. Big Data, Seattle, WA, USA, Dec. 2018, pp. 2775–2784.

A. Meier and M. Kaufmann, “NoSQL Databases,” in SQL & NoSQL Databases: Models, Languages, Consistency Options and Architectures for Big Data Management. Wiesbaden, Germany: Springer Vieweg, 2019, pp. 201–218.

V. M. Ngo, N.-A. Le-Khac, and M-T. Kechadi, “Designing and implementing data warehouse for agricultural big data,” in Proc. 8th Int. Congr., Held as Part of the Services Conf. Federation, San Diego, CA, USA, Jun. 2019, pp. 1–17, doi: 10.1007/978-3-030-23551-2_1.

H. S. Cha et al., “The Korea cancer big data platform (K-CBP) for cancer research,” Int. J. Environ. Res. Public. Health, vol. 16, no. 13, Jun. 2019, Art. no. 2290, doi: 10.3390/ijerph16132290.

H. Zheng and X. Jiang, “Design and implementation of college consumption analysis system based on NoSQL database,” in Proc. 13th Int. Conf. Comput. Sci. Educ. (ICCSE), Colombo, Sri Lanka, Aug. 2018, pp. 1–5.

H. Ganu and P. Viswa Datha, “Fast query expansion on an accounting corpus using sub-word embeddings,” in Proc. 2nd Workshop Subword/Character LEvel Models, New Orleans, LA, USA, Jun. 2018, pp. 61–65.

Elasticsearch. Mapping | Elasticsearch Guide [8.12] | Elastic. (2024). Accessed: Feb. 26, 2024. [Online]. Available: https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping.html

D. Brimley. “What is an Elasticsearch index?.” ELASTIC.co. https://www.elastic.co/blog/what-is-an-elasticsearch-index (accessed Feb. 26, 2024).

Elasticsearch. Thai tokenizer | Elasticsearch Guide [8.11] | Elastic. (2024). Accessed: Jan. 5, 2024. [Online]. Available: https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-thai-tokenizer.html

Elasticsearch. N-gram tokenizer | Elasticsearch Guide [8.11] | Elastic. (2024). Accessed: Jan. 5, 2024. [Online]. Available: https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-ngram-tokenizer.html

Elasticsearch. Autocomplete | Documentation. (2024). Accessed: Feb. 27, 2024. [Online]. Available: https://docs.elastic.co/search-ui/solutions/ecommerce/autocomplete

Kibana: Explore, Visualize, Discover Data. (2020). Elasticsearch. Accessed: Dec. 13, 2020. [Online]. Available: https://www.elastic.co/kibana

Power BI - Data Visualization | Microsoft Power Platform. (2024). Microsoft. Accessed: Jan. 5, 2024. [Online]. Available: https://www.microsoft.com/en-us/power-platform/products/power-bi

Tech2Biz. “TechPropose.” TECH2BIZ.net. https://www.tech2biz.net/content/inventor (accessed Feb. 27, 2024).